Jul 07 17:42:04 devstack cinder-volume[75972]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:42:04 devstack cinder-volume[75972]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:42:04 devstack cinder-volume[75972]: we strongly recommend against using it for new projects. Jul 07 17:42:04 devstack cinder-volume[75972]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:42:04 devstack cinder-volume[75972]: framework. For more detail see Jul 07 17:42:04 devstack cinder-volume[75972]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:42:04 devstack cinder-volume[75972]: import eventlet # noqa Jul 07 17:42:07 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:42:07 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:42:07 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:42:07 devstack cinder-volume[75972]: INFO dbcounter [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Registered counter for database cinder Jul 07 17:42:08 devstack cinder-volume[75972]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:42:08 devstack cinder-volume[75972]: DEBUG dbcounter [-] [75972] Writer thread running {{(pid=75972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:42:08 devstack cinder-volume[75972]: INFO cinder.rpc [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:42:08 devstack cinder-volume[75972]: INFO cinder.rpc [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:42:08 devstack cinder-volume[75972]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:42:08 devstack cinder-volume[75972]: INFO cinder.volume.manager [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Determined volume DB was empty at startup. Jul 07 17:42:08 devstack cinder-volume[75972]: DEBUG cinder.volume.manager [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75972) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:42:08 devstack cinder-volume[75972]: INFO cinder.volume.manager [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:42:08 devstack cinder-volume[75972]: WARNING stevedore.named [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:42:08 devstack cinder-volume[75972]: WARNING castellan.key_manager [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:42:08 devstack cinder-volume[75972]: WARNING cinder.keymgr.conf_key_mgr [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:42:08 devstack cinder-volume[75972]: DEBUG cinder.volume.drivers.lvm [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75972) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 17:42:08 devstack cinder-volume[75972]: DEBUG oslo_concurrency.processutils [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_concurrency.processutils [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] CMD "cinder-rtstool verify" returned: 0 in 0.599s {{(pid=75972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:42:09 devstack cinder-volume[75972]: INFO cinder.rpc [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 17:42:09 devstack cinder-volume[75972]: INFO cinder.rpc [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 17:42:09 devstack cinder-volume[75972]: WARNING stevedore.named [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:42:09 devstack cinder-volume[75972]: WARNING castellan.key_manager [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:42:09 devstack cinder-volume[75972]: INFO cinder.volume.manager [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_db.sqlalchemy.engines [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:42:09 devstack cinder-volume[75972]: INFO oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Starting 1 workers Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Started child 76140 {{(pid=75972) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Full set of CONF: {{(pid=75972) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] ******************************************************************************** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Configuration options gathered from: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] ================================================================================ {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] allow_availability_zone_fallback = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] allow_compression_on_image_upload = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] allowed_direct_url_schemes = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] api_rate_limit = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] auth_strategy = keystone {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] az_cache_duration = 3600 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_availability_zone = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_host = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_stats_polling_interval = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backup_api_class = cinder.backup.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[76140]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backup_name_template = backup-%s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backup_use_same_host = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backup_use_temp_snapshot = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] chap_password = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] chap_username = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_internal_tenant_project_id = 25525080a5304cd480986eee2829b5ca {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_internal_tenant_user_id = 5cc12dff78764b499f57932e15a8c131 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cloned_volume_same_az = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cluster = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] compression_format = gzip {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] compute_api_class = cinder.compute.nova.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] config_dir = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] config_source = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] control_exchange = openstack {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] debug = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] default_availability_zone = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] default_group_type = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] default_volume_type = lvmdriver-1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] disk_geometry = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] driver_client_cert = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] driver_client_cert_key = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] driver_data_namespace = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] driver_ssl_cert_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] driver_ssl_cert_verify = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] driver_use_ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] enable_force_upload = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] enable_new_services = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] enable_unsupported_driver = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] enforce_multipath_for_image_xfer = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] filter_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_api_insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_api_servers = ['http://192.168.122.177/image'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_api_ssl_compression = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_ca_certificates_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_catalog_info = image:glance:publicURL {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_num_retries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance_request_timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] goodness_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] graceful_shutdown_timeout = 5 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] group_api_class = cinder.group.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] host = devstack {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_compress_on_upload = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_conversion_address_space_limit = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_conversion_cpu_limit = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_conversion_disable = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_upload_use_cinder_backend = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_upload_use_internal_tenant = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_volume_cache_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_volume_cache_max_count = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] image_volume_cache_max_size_gb = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] init_host_max_objects_retrieval = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] instance_format = [instance: %(uuid)s] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] iscsi_target_flags = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] iscsi_write_cache = on {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] iser_helper = tgtadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] iser_ip_address = 192.168.122.177 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] iser_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_color = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_config_append = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_dir = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_options = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_rotate_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_rotate_interval_type = days {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] log_rotation_type = none {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] max_age = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] max_logfile_count = 30 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] max_logfile_size_mb = 200 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] max_over_subscription_ratio = 20.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] message_reap_interval = 86400 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] message_ttl = 2592000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] migration_create_volume_timeout_secs = 300 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] monkey_patch = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] monkey_patch_modules = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] my_ip = 192.168.122.177 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] no_snapshot_gb_quota = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] num_iser_scan_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] num_shell_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] num_volume_device_scan_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] nvmeof_conn_info_version = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] nvmet_ns_id = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] nvmet_port_id = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] osapi_max_limit = 1000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] osapi_volume_ext_list = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] osapi_volume_listen_port = 8776 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] osapi_volume_use_ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] osapi_volume_workers = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] per_volume_size_limit = -1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] periodic_fuzzy_delay = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] periodic_interval = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] public_endpoint = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] publish_errors = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] quota_backup_gigabytes = 1000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] quota_backups = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] quota_gigabytes = 1000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] quota_groups = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] quota_snapshots = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] quota_volumes = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] rate_limit_burst = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] rate_limit_except_level = CRITICAL {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] rate_limit_interval = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] reinit_driver_count = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] replication_device = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] report_discard_supported = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] report_interval = 120 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] reservation_clean_interval = 86400 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] reservation_expire = 86400 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] reserved_image_namespaces = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] reserved_percentage = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] rpc_response_timeout = 120 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] run_external_periodic_tasks = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] scst_target_driver = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] scst_target_iqn_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_down_time = 720 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] shell_completion = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] snapshot_name_template = snapshot-%s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] snapshot_same_host = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] state_path = /opt/stack/data/cinder {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] storage_availability_zone = nova {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] storage_protocol = iSCSI {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] syslog_log_facility = LOG_USER {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] target_helper = lioadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] target_ip_address = 192.168.122.177 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] target_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] target_protocol = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] target_secondary_ip_addresses = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] trace_flags = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] transport_url = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] until_refresh = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] use_chap_auth = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] use_default_quota_class = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] use_journal = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] use_json = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] use_multipath_for_image_xfer = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] use_stderr = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] use_syslog = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] verify_glance_signatures = enabled {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_api_class = cinder.volume.api.API {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_backend_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_clear = zero {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_clear_ionice = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_clear_size = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_copy_bps_limit = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_dd_blocksize = 1M {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_name_template = volume-%s {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_service_inithost_offload = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volume_usage_audit_period = month {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] zoning_mode = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_concurrency.disable_process_locking = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.auth_section = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.auth_type = password {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.auth_version = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.cache = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.include_service_catalog = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.interface = public {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_password = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcache_username = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.region_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.service_type = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.177/identity {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.backend = dogpile.cache.null {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.backend_argument = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.backend_expiration_time = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.config_prefix = cache.oslo {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.debug_cache_backend = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.enable_retry_client = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.enable_socket_keepalive = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.expiration_time = 600 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.hashclient_retry_attempts = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.memcache_dead_retry = 300 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.memcache_pool_maxsize = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.memcache_sasl_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.password = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.proxies = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.redis_db = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.redis_server = localhost:6379 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.retry_attempts = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.retry_delay = 0.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.socket_keepalive_count = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.socket_keepalive_idle = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.socket_keepalive_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.socket_timeout = 1.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.tls_allowed_ciphers = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.tls_cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.tls_certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.tls_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.tls_keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cache.username = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.asyncio_connection = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.asyncio_slave_connection = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.backend = sqlalchemy {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.connection = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.connection_debug = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.connection_parameters = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.connection_recycle_time = 3600 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.connection_trace = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.db_inc_retry_interval = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.db_max_retries = 20 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.db_max_retry_interval = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.db_retry_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.max_overflow = 50 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.max_pool_size = 5 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.max_retries = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.mysql_wsrep_sync_wait = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.pool_timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.retry_interval = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.slave_connection = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.sqlite_synchronous = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.synchronous_reader = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] database.use_db_reconnect = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.connection_string = messaging:// {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.es_doc_type = notification {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.es_scroll_size = 10000 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.es_scroll_time = 2m {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.filter_error_trace = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.hmac_keys = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.sentinel_service_name = mymaster {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.socket_timeout = 0.1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.trace_requests = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler.trace_sqlalchemy = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler_jaeger.process_tags = {} {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler_jaeger.service_name_prefix = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] profiler_otlp.service_name_prefix = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.enforce_new_defaults = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.enforce_scope = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.policy_default_rule = default {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.policy_file = policy.yaml {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] coordination.backend_url = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] privsep_osbrick.group = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] privsep_osbrick.helper_command = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] privsep_osbrick.user = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_sys_admin.group = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_sys_admin.helper_command = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] cinder_sys_admin.user = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.auth_section = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.auth_type = password {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.collect_timing = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.send_service_user_token = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] service_user.timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.auth_section = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.auth_type = password {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.collect_timing = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.region_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] glance.timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.backend_availability_zone = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.chap_password = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.chap_username = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.disk_geometry = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.driver_client_cert = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.driver_client_cert_key = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.driver_data_namespace = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.driver_use_ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.extra_capabilities = {} {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.filter_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.goodness_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.iscsi_target_flags = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.iscsi_write_cache = on {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.iser_helper = tgtadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.iser_ip_address = 192.168.122.177 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.iser_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.lvm_share_target = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.lvm_type = auto {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.num_shell_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.replication_device = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.report_discard_supported = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.reserved_percentage = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.target_helper = tgtadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:09 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.target_ip_address = 192.168.122.177 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.target_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.target_protocol = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.trace_flags = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.unique_fqdn_network = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.use_chap_auth = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_backend_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_clear = zero {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_clear_ionice = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_clear_size = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_reports.file_event_handler = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_reports.log_dir = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.backend_host = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.chap_password = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.chap_username = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.disk_geometry = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.driver_client_cert = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.extra_capabilities = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.filter_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.goodness_function = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.iser_helper = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.iser_ip_address = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.iser_port = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.lvm_share_target = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.lvm_type = auto {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.num_shell_tries = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.replication_device = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.report_discard_supported = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.reserved_percentage = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.scst_target_driver = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.storage_protocol = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.target_helper = lioadm {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.target_ip_address = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.target_port = 3260 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.trace_flags = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.use_chap_auth = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_clear = zero {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_clear_size = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] lvmdriver-1.volumes_dir = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_notifications.driver = [] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_notifications.retry = -1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] key_manager.fixed_key = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.barbican_api_version = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.barbican_endpoint = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.barbican_endpoint_type = public {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.barbican_region_name = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.collect_timing = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.number_of_retries = 60 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.retry_delay = 1 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.send_service_user_token = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.verify_ssl = True {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican.verify_ssl_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.auth_section = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.auth_type = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.cafile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.certfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.collect_timing = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.insecure = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.keyfile = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.split_loggers = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] barbican_service_user.timeout = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.approle_role_id = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.approle_secret_id = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.kv_mountpoint = secret {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.kv_path = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.kv_version = 2 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.namespace = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.root_token_id = **** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.ssl_ca_crt_file = None {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.timeout = 60.0 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.use_ssl = False {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:42:09 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] ******************************************************************************** {{(pid=75972) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:42:10 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:10 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.735s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:10 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:10 devstack sudo[76355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:10 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:11 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.678s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:42:11 devstack cinder-volume[76140]: INFO cinder.brick.local_dev.lvm [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 17:42:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:11 devstack sudo[76599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:42:11 devstack sudo[76599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:11 devstack sudo[76599]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.831s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:11 devstack cinder-volume[76140]: DEBUG cinder.brick.local_dev.lvm [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76140) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 17:42:11 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:11 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:11 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:13 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.141s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack sudo[76918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:13 devstack sudo[76918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:13 devstack sudo[76918]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.706s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:13 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:13 devstack sudo[76924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 17:42:13 devstack sudo[76924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:14 devstack sudo[76924]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:14 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.747s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:14 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:14 devstack sudo[76928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:42:14 devstack sudo[76928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:15 devstack sudo[76928]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:15 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.904s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:15 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:15 devstack sudo[76934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:42:15 devstack sudo[76934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:16 devstack sudo[76934]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:16 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.757s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:16 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:16 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:42:16 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:17 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:17 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.842s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:17 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:17 devstack sudo[76951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:17 devstack sudo[76951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:17 devstack sudo[76951]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:17 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.696s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:17 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:17 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:17 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:17 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:17 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:18 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:18 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.856s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:18 devstack cinder-volume[76140]: INFO cinder.volume.drivers.lvm [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 17:42:18 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:18 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:18 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:18 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:18 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:19 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:19 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.734s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:19 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:42:19 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:19 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:42:19 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:19 devstack cinder-volume[75972]: DEBUG dbcounter [-] [75972] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:20 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:20 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.771s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:20 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:20 devstack sudo[77089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:42:20 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:20 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:20 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.733s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:20 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:20 devstack sudo[77092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:20 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:21 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:21 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.745s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:21 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:21 devstack sudo[77096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:42:21 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:22 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:22 devstack cinder-volume[76140]: INFO cinder.volume.driver [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:42:22 devstack cinder-volume[76140]: DEBUG cinder.volume.driver [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76140) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:42:22 devstack cinder-volume[76140]: DEBUG oslo_db.sqlalchemy.engines [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:42:22 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writer thread running {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:42:22 devstack cinder-volume[76140]: DEBUG cinder.db.sqlalchemy.api [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Building query based on filter {{(pid=76140) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 07 17:42:22 devstack cinder-volume[76140]: DEBUG cinder.image.image_utils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76140) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:42:22 devstack cinder-volume[76140]: INFO cinder.keymgr.migration [None req-e5913a87-a206-495f-8ebf-afd8ef05dcad None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:42:22 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:42:22 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:22 devstack sudo[77115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:42:22 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:23 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:23 devstack sudo[77143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:42:23 devstack sudo[77143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:23 devstack sudo[77143]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:23 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:23 devstack sudo[77146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:23 devstack sudo[77146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:24 devstack sudo[77146]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:24 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:24 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:24 devstack sudo[77149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:42:24 devstack sudo[77149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:25 devstack sudo[77149]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:25 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:25 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:42:25 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Driver initialization completed successfully. Jul 07 17:42:25 devstack cinder-volume[76140]: INFO cinder.manager [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Initiating service 2 cleanup Jul 07 17:42:25 devstack cinder-volume[76140]: INFO cinder.manager [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Service 2 cleanup completed. Jul 07 17:42:25 devstack cinder-volume[76140]: DEBUG cinder.service [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Creating RPC server for service cinder-volume {{(pid=76140) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:42:25 devstack cinder-volume[76140]: DEBUG cinder.service [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76140) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:42:25 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 17:42:25 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:42:25 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:25 devstack sudo[77291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:42:25 devstack sudo[77291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:26 devstack sudo[77291]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:26 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:26 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[77294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:42:26 devstack sudo[77294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:26 devstack sudo[77294]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:26 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:26 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:26 devstack sudo[77300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:42:26 devstack sudo[77300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:27 devstack sudo[77300]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:27 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:27 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:42:27 devstack sudo[77303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:42:27 devstack sudo[77303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:42:28 devstack sudo[77303]: pam_unix(sudo:session): session closed for user root Jul 07 17:42:28 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:42:28 devstack cinder-volume[76140]: INFO cinder.volume.manager [None req-e7eaa886-147f-42e6-b1d3-88df19db42dd None None] Driver post RPC initialization completed successfully. Jul 07 17:42:38 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:42:38 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:43:03 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running periodic task VolumeManager._thread_info {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:43:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] thread count: 6 {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:43:03 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] thread info: [<_MainThread(MainThread, started 124307173445760)>, , , , , ] {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:44:03 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:44:03 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:44:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:03 devstack sudo[82212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:44:03 devstack sudo[82212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:03 devstack sudo[82212]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:03 devstack sudo[82215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:44:03 devstack sudo[82215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:04 devstack sudo[82215]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:04 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:04 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:04 devstack sudo[82234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:44:04 devstack sudo[82234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:05 devstack sudo[82234]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.703s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:44:05 devstack sudo[82237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:44:05 devstack sudo[82237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:44:05 devstack sudo[82237]: pam_unix(sudo:session): session closed for user root Jul 07 17:44:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:44:05 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:44:05 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running periodic task VolumeManager._thread_info {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:44:05 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] thread count: 6 {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:44:05 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] thread info: [<_MainThread(MainThread, started 124307173445760)>, , , , , ] {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:44:38 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:44:38 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:45:03 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:45:03 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:45:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:03 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:45:03 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:03 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.706s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:03 devstack sudo[83556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:45:03 devstack sudo[83556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:04 devstack sudo[83556]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:04 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:04 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:04 devstack sudo[83568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:45:04 devstack sudo[83568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:05 devstack sudo[83568]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:45:05 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:45:05 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:45:05 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Jul 07 17:45:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:45:05 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:45:05 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running periodic task VolumeManager._thread_info {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:45:05 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] thread count: 6 {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:45:05 devstack cinder-volume[76140]: DEBUG cinder.volume.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] thread info: [<_MainThread(MainThread, started 124307173445760)>, , , , , ] {{(pid=76140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:46:03 devstack cinder-volume[76140]: DEBUG oslo_service.periodic_task [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:46:03 devstack cinder-volume[76140]: DEBUG cinder.volume.drivers.lvm [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Updating volume stats {{(pid=76140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:46:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:03 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:46:03 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:03 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:03 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:03 devstack sudo[85119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:46:03 devstack sudo[85119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:04 devstack sudo[85119]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:04 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:04 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:04 devstack sudo[85128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:46:04 devstack sudo[85128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:05 devstack sudo[85128]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:46:05 devstack sudo[85132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:46:05 devstack sudo[85132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:46:05 devstack sudo[85132]: pam_unix(sudo:session): session closed for user root Jul 07 17:46:05 devstack cinder-volume[76140]: DEBUG oslo_concurrency.processutils [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:46:05 devstack cinder-volume[76140]: DEBUG cinder.manager [None req-bd90a9eb-b359-4639-989b-8f62a8f7661c None None] Notifying Schedulers of capabilities ... {{(pid=76140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:46:38 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:SELECT=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:46:38 devstack cinder-volume[76140]: DEBUG dbcounter [-] [76140] Writing DB stats cinder:UPDATE=1 {{(pid=76140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:46:57 devstack cinder-volume[75972]: INFO oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Caught SIGTERM, stopping children Jul 07 17:46:57 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Acquiring lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:46:57 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Acquired lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:46:57 devstack cinder-volume[75972]: DEBUG oslo_concurrency.lockutils [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Releasing lock "singleton_lock" {{(pid=75972) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:46:57 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Stop services. {{(pid=75972) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:46:57 devstack cinder-volume[75972]: DEBUG oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Killing children. {{(pid=75972) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:46:57 devstack cinder-volume[75972]: INFO oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Waiting on 1 children to exit Jul 07 17:47:00 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Acquiring lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:47:00 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Acquired lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:47:00 devstack cinder-volume[76140]: DEBUG oslo_concurrency.lockutils [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Releasing lock "singleton_lock" {{(pid=76140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:47:00 devstack cinder-volume[76140]: WARNING amqp [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:47:00 devstack cinder-volume[76140]: WARNING amqp [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:47:00 devstack cinder-volume[75972]: INFO oslo_service.backend._eventlet.service [None req-1e9a71f2-6a15-4c93-9904-f2ca5cb2c285 None None] Child 76140 exited with status 0 Jul 07 17:47:00 devstack cinder-volume[86370]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:47:00 devstack cinder-volume[86370]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:47:00 devstack cinder-volume[86370]: we strongly recommend against using it for new projects. Jul 07 17:47:00 devstack cinder-volume[86370]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:47:00 devstack cinder-volume[86370]: framework. For more detail see Jul 07 17:47:00 devstack cinder-volume[86370]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:47:00 devstack cinder-volume[86370]: import eventlet # noqa Jul 07 17:47:03 devstack cinder-volume[86370]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:47:03 devstack cinder-volume[86370]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:47:03 devstack cinder-volume[86370]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:47:03 devstack cinder-volume[86370]: INFO dbcounter [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Registered counter for database cinder Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG dbcounter [-] [86370] Writer thread running {{(pid=86370) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:47:04 devstack cinder-volume[86370]: INFO cinder.rpc [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:47:04 devstack cinder-volume[86370]: INFO cinder.rpc [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:47:04 devstack cinder-volume[86370]: INFO cinder.volume.manager [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Determined volume DB was empty at startup. Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG cinder.volume.manager [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86370) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:47:04 devstack cinder-volume[86370]: INFO cinder.volume.manager [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:47:04 devstack cinder-volume[86370]: WARNING stevedore.named [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:47:04 devstack cinder-volume[86370]: WARNING castellan.key_manager [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:47:04 devstack cinder-volume[86370]: WARNING cinder.keymgr.conf_key_mgr [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:47:04 devstack cinder-volume[86370]: INFO cinder.volume.manager [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_db.sqlalchemy.engines [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86370) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:47:04 devstack cinder-volume[86370]: INFO oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Starting 1 workers Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Started child 86654 {{(pid=86370) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Full set of CONF: {{(pid=86370) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] ******************************************************************************** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Configuration options gathered from: {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] ================================================================================ {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] allow_availability_zone_fallback = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] allow_compression_on_image_upload = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] allowed_direct_url_schemes = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86654]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] api_rate_limit = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] auth_strategy = keystone {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_availability_zone = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_host = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_stats_polling_interval = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backup_api_class = cinder.backup.api.API {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backup_name_template = backup-%s {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backup_use_same_host = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backup_use_temp_snapshot = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] chap_password = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] chap_username = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_internal_tenant_project_id = 25525080a5304cd480986eee2829b5ca {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_internal_tenant_user_id = 5cc12dff78764b499f57932e15a8c131 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cluster = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] compression_format = gzip {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] compute_api_class = cinder.compute.nova.API {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] config_dir = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] config_source = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] control_exchange = openstack {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] debug = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] default_availability_zone = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] default_group_type = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] default_volume_type = QuobyteHD {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] disk_geometry = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] driver_client_cert = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] driver_client_cert_key = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] driver_data_namespace = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] driver_ssl_cert_path = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] driver_ssl_cert_verify = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] driver_use_ssl = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] enable_new_services = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] enable_unsupported_driver = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] enabled_backends = ['QuobyteHD'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] enforce_multipath_for_image_xfer = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] filter_function = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_api_insecure = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_api_servers = ['http://192.168.122.177/image'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_api_ssl_compression = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_ca_certificates_file = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_catalog_info = image:glance:publicURL {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_certfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_keyfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_num_retries = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance_request_timeout = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] goodness_function = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] graceful_shutdown_timeout = 5 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] group_api_class = cinder.group.api.API {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] host = devstack {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_compress_on_upload = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_conversion_address_space_limit = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_conversion_cpu_limit = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_conversion_disable = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86654]: INFO cinder.volume.manager [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_upload_use_cinder_backend = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_upload_use_internal_tenant = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_volume_cache_enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_volume_cache_max_count = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] image_volume_cache_max_size_gb = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] init_host_max_objects_retrieval = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] instance_format = [instance: %(uuid)s] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] iscsi_target_flags = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] iscsi_write_cache = on {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] iser_helper = tgtadm {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] iser_ip_address = 192.168.122.177 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.remotefs [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86654) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] iser_port = 3260 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_color = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_config_append = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_dir = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_file = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_options = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_rotate_interval = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_rotate_interval_type = days {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] log_rotation_type = none {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] max_age = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] max_logfile_count = 30 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] max_logfile_size_mb = 200 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] max_over_subscription_ratio = 20.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] message_reap_interval = 86400 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] message_ttl = 2592000 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] migration_create_volume_timeout_secs = 300 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] monkey_patch = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] monkey_patch_modules = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] my_ip = 192.168.122.177 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] no_snapshot_gb_quota = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] num_iser_scan_tries = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] num_shell_tries = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] num_volume_device_scan_tries = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] nvmeof_conn_info_version = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] nvmet_ns_id = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] nvmet_port_id = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] osapi_max_limit = 1000 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] osapi_volume_ext_list = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] osapi_volume_listen_port = 8776 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] osapi_volume_use_ssl = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] osapi_volume_workers = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] per_volume_size_limit = -1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] periodic_fuzzy_delay = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] periodic_interval = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] public_endpoint = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] publish_errors = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] quota_backup_gigabytes = 1000 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] quota_backups = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] quota_gigabytes = 1000 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] quota_groups = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] quota_snapshots = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] quota_volumes = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] rate_limit_burst = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] rate_limit_except_level = CRITICAL {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] rate_limit_interval = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] reinit_driver_count = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] replication_device = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] report_discard_supported = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] report_interval = 120 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] reservation_clean_interval = 86400 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] reservation_expire = 86400 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] reserved_image_namespaces = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] reserved_percentage = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] rpc_response_timeout = 120 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] run_external_periodic_tasks = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] scst_target_driver = iscsi {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] scst_target_iqn_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_down_time = 720 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] shell_completion = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] snapshot_name_template = snapshot-%s {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] split_loggers = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] state_path = /opt/stack/data/cinder {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] storage_availability_zone = nova {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] storage_protocol = iSCSI {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] syslog_log_facility = LOG_USER {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] target_helper = lioadm {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] target_ip_address = 192.168.122.177 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] target_port = 3260 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] target_protocol = iscsi {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] target_secondary_ip_addresses = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] trace_flags = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] transport_url = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] until_refresh = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] use_chap_auth = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] use_default_quota_class = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] use_journal = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] use_json = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] use_multipath_for_image_xfer = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] use_stderr = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] use_syslog = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] verify_glance_signatures = enabled {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_api_class = cinder.volume.api.API {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_backend_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_clear = zero {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_clear_ionice = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_clear_size = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_copy_bps_limit = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_dd_blocksize = 1M {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_name_template = volume-%s {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_service_inithost_offload = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volume_usage_audit_period = month {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] zoning_mode = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_concurrency.disable_process_locking = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.auth_section = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.auth_type = password {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.auth_version = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.cache = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.certfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.include_service_catalog = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.insecure = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.interface = public {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.keyfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_password = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcache_username = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.region_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.service_type = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.177/identity {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.backend = dogpile.cache.null {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.backend_argument = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.backend_expiration_time = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.config_prefix = cache.oslo {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.debug_cache_backend = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.enable_retry_client = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.enable_socket_keepalive = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.expiration_time = 600 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.hashclient_retry_attempts = 2 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.memcache_dead_retry = 300 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.memcache_pool_maxsize = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.memcache_sasl_enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.password = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.proxies = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.redis_db = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.redis_server = localhost:6379 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.retry_attempts = 2 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.retry_delay = 0.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.socket_keepalive_count = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.socket_keepalive_idle = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.socket_keepalive_interval = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.socket_timeout = 1.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.tls_allowed_ciphers = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.tls_cafile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.tls_certfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.tls_enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.tls_keyfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cache.username = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.asyncio_connection = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.asyncio_slave_connection = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.backend = sqlalchemy {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.connection = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.connection_debug = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.connection_parameters = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.connection_recycle_time = 3600 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.connection_trace = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.db_inc_retry_interval = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.db_max_retries = 20 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.db_max_retry_interval = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.db_retry_interval = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.max_overflow = 50 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.max_pool_size = 5 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.max_retries = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.mysql_wsrep_sync_wait = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.pool_timeout = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.retry_interval = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.slave_connection = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.sqlite_synchronous = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.synchronous_reader = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] database.use_db_reconnect = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.connection_string = messaging:// {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.es_doc_type = notification {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.es_scroll_size = 10000 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.es_scroll_time = 2m {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.filter_error_trace = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.hmac_keys = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.sentinel_service_name = mymaster {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.socket_timeout = 0.1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.trace_requests = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler.trace_sqlalchemy = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler_jaeger.process_tags = {} {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler_jaeger.service_name_prefix = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] profiler_otlp.service_name_prefix = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.enforce_new_defaults = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.enforce_scope = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.policy_default_rule = default {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.policy_file = policy.yaml {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] coordination.backend_url = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] privsep_osbrick.group = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] privsep_osbrick.helper_command = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] privsep_osbrick.user = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_sys_admin.group = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_sys_admin.helper_command = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] cinder_sys_admin.user = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.auth_section = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.auth_type = password {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.cafile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.certfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.collect_timing = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.insecure = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.keyfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.send_service_user_token = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.split_loggers = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] service_user.timeout = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.auth_section = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.auth_type = password {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.certfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.collect_timing = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.insecure = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.keyfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.region_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.split_loggers = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] glance.timeout = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.backend_availability_zone = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.chap_password = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.chap_username = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.disk_geometry = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.driver_client_cert = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.driver_client_cert_key = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.driver_data_namespace = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.driver_use_ssl = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.extra_capabilities = {} {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:04 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.filter_function = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.goodness_function = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.iscsi_target_flags = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.iscsi_write_cache = on {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.iser_helper = tgtadm {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.iser_ip_address = 192.168.122.177 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.iser_port = 3260 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_host = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_login = admin {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_mount_options = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_password = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_private_key = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_share_path = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.num_shell_tries = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.quobyte_volume_url = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.replication_device = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.report_discard_supported = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.reserved_percentage = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.target_helper = tgtadm {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.target_ip_address = 192.168.122.177 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.target_port = 3260 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.target_protocol = iscsi {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.trace_flags = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.unique_fqdn_network = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.use_chap_auth = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volume_backend_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volume_clear = zero {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volume_clear_ionice = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volume_clear_size = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86654) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_reports.file_event_handler = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_reports.log_dir = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.backend_availability_zone = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.backend_host = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86654]: WARNING cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86654]: WARNING cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.chap_password = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.chap_username = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.chiscsi_conf = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.disk_geometry = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.driver_client_cert = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.driver_data_namespace = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.driver_use_ssl = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.extra_capabilities = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.filter_function = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.goodness_function = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Running cmd (subprocess): mount.quobyte {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.iser_helper = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.iser_ip_address = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.iser_port = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.iser_target_prefix = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_host = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_login = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_mount_options = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_password = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_private_key = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_share_path = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_ssh_port = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.num_shell_tries = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.nvmet_port_id = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.replication_device = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.report_discard_supported = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.reserved_percentage = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.scst_target_driver = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.storage_protocol = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.target_helper = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.target_ip_address = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.target_port = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.target_prefix = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.target_protocol = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.trace_flags = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.use_chap_auth = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volume_clear = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volume_clear_size = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] QuobyteHD.volumes_dir = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.ssl = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_notifications.driver = [] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_notifications.retry = -1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] key_manager.fixed_key = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.barbican_api_version = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.barbican_endpoint = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.barbican_endpoint_type = public {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.barbican_region_name = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.cafile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.certfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.collect_timing = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.insecure = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.keyfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.number_of_retries = 60 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.retry_delay = 1 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.send_service_user_token = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.split_loggers = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.timeout = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.verify_ssl = True {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican.verify_ssl_path = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.auth_section = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.auth_type = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.cafile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.certfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.collect_timing = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.insecure = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.keyfile = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.split_loggers = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] barbican_service_user.timeout = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.approle_role_id = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.approle_secret_id = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.kv_mountpoint = secret {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.kv_path = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.kv_version = 2 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.namespace = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.root_token_id = **** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.ssl_ca_crt_file = None {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.timeout = 60.0 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.use_ssl = False {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:05 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] ******************************************************************************** {{(pid=86370) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:47:05 devstack quobyte-client[86656]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 17:47:05 devstack quobyte-client[86656]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=86654) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:05 devstack cinder-volume[86654]: INFO cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 ... Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b -c /etc/quobyte/client-cinder.cfg {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:05 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b -c /etc/quobyte/client-cinder.cfg Jul 07 17:47:05 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:05 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.780s {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:05 devstack cinder-volume[86654]: INFO cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 succeeded Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=86654) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.793s {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:05 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:05 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:47:05 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:06 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.660s {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:06 devstack cinder-volume[86654]: INFO cinder.volume.driver [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG cinder.volume.driver [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.690715789795, 'free_capacity_gb': 1775.690715789795, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86654) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG oslo_db.sqlalchemy.engines [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86654) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG dbcounter [-] [86654] Writer thread running {{(pid=86654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG cinder.db.sqlalchemy.api [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Building query based on filter {{(pid=86654) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG cinder.image.image_utils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86654) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:47:06 devstack cinder-volume[86654]: INFO cinder.keymgr.migration [None req-f1de0184-313b-40d2-bc50-8cfc882d93fb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=86654) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=86654) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:06 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:06 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:47:06 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:07 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.662s {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG cinder.manager [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Notifying Schedulers of capabilities ... {{(pid=86654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:47:07 devstack cinder-volume[86654]: INFO cinder.volume.manager [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Driver initialization completed successfully. Jul 07 17:47:07 devstack cinder-volume[86654]: INFO cinder.manager [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Initiating service 3 cleanup Jul 07 17:47:07 devstack cinder-volume[86654]: INFO cinder.manager [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Service 3 cleanup completed. Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG cinder.service [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Creating RPC server for service cinder-volume {{(pid=86654) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG cinder.service [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86654) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:47:07 devstack cinder-volume[86654]: INFO cinder.volume.manager [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=86654) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=86654) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:07 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:07 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:47:07 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:08 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:08 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.028s {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:08 devstack cinder-volume[86654]: INFO cinder.volume.manager [None req-6e0e1673-aace-4fdc-9467-4f2c3478dd9f None None] Driver post RPC initialization completed successfully. Jul 07 17:47:12 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-7e0f834e-ca12-4ef9-82a2-9959b6d363a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:12 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-7e0f834e-ca12-4ef9-82a2-9959b6d363a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:12 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f834e-ca12-4ef9-82a2-9959b6d363a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=86654) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:12 devstack cinder-volume[86654]: DEBUG cinder.volume.drivers.quobyte [None req-7e0f834e-ca12-4ef9-82a2-9959b6d363a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=86654) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:12 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-7e0f834e-ca12-4ef9-82a2-9959b6d363a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86654) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:12 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-7e0f834e-ca12-4ef9-82a2-9959b6d363a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:12 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:47:12 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:12 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:12 devstack cinder-volume[86654]: DEBUG oslo_concurrency.processutils [None req-7e0f834e-ca12-4ef9-82a2-9959b6d363a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.657s {{(pid=86654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:12 devstack cinder-volume[86654]: DEBUG cinder.manager [None req-7e0f834e-ca12-4ef9-82a2-9959b6d363a2 None None] Notifying Schedulers of capabilities ... {{(pid=86654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:47:13 devstack cinder-volume[86370]: INFO oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Caught SIGTERM, stopping children Jul 07 17:47:13 devstack cinder-volume[86370]: DEBUG oslo_concurrency.lockutils [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Acquiring lock "singleton_lock" {{(pid=86370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:47:13 devstack cinder-volume[86370]: DEBUG oslo_concurrency.lockutils [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Acquired lock "singleton_lock" {{(pid=86370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:47:13 devstack cinder-volume[86370]: DEBUG oslo_concurrency.lockutils [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Releasing lock "singleton_lock" {{(pid=86370) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:47:13 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Stop services. {{(pid=86370) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:47:13 devstack cinder-volume[86370]: DEBUG oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Killing children. {{(pid=86370) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:47:13 devstack cinder-volume[86370]: INFO oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Waiting on 1 children to exit Jul 07 17:47:15 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Acquiring lock "singleton_lock" {{(pid=86654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:47:15 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Acquired lock "singleton_lock" {{(pid=86654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:47:15 devstack cinder-volume[86654]: DEBUG oslo_concurrency.lockutils [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Releasing lock "singleton_lock" {{(pid=86654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:47:15 devstack cinder-volume[86654]: WARNING amqp [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:47:15 devstack cinder-volume[86654]: WARNING amqp [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:47:15 devstack cinder-volume[86370]: INFO oslo_service.backend._eventlet.service [None req-0ef01fa4-0681-44c2-8013-1867036bb685 None None] Child 86654 exited with status 0 Jul 07 17:47:16 devstack cinder-volume[86975]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:47:16 devstack cinder-volume[86975]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:47:16 devstack cinder-volume[86975]: we strongly recommend against using it for new projects. Jul 07 17:47:16 devstack cinder-volume[86975]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:47:16 devstack cinder-volume[86975]: framework. For more detail see Jul 07 17:47:16 devstack cinder-volume[86975]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:47:16 devstack cinder-volume[86975]: import eventlet # noqa Jul 07 17:47:19 devstack cinder-volume[86975]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:47:19 devstack cinder-volume[86975]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:47:19 devstack cinder-volume[86975]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86975) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:47:20 devstack cinder-volume[86975]: INFO dbcounter [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Registered counter for database cinder Jul 07 17:47:20 devstack cinder-volume[86975]: DEBUG oslo_db.sqlalchemy.engines [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG dbcounter [-] [86975] Writer thread running {{(pid=86975) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:47:21 devstack cinder-volume[86975]: INFO cinder.rpc [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:47:21 devstack cinder-volume[86975]: INFO cinder.rpc [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_db.sqlalchemy.engines [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:47:21 devstack cinder-volume[86975]: INFO cinder.volume.manager [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Determined volume DB was empty at startup. Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG cinder.volume.manager [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86975) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:47:21 devstack cinder-volume[86975]: WARNING stevedore.named [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:47:21 devstack cinder-volume[86975]: WARNING castellan.key_manager [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:47:21 devstack cinder-volume[86975]: WARNING cinder.keymgr.conf_key_mgr [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:47:21 devstack cinder-volume[86975]: INFO cinder.volume.manager [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_db.sqlalchemy.engines [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:47:21 devstack cinder-volume[86975]: INFO oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Starting 1 workers Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Started child 87228 {{(pid=86975) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Full set of CONF: {{(pid=86975) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] ******************************************************************************** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] Configuration options gathered from: {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] ================================================================================ {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] allow_availability_zone_fallback = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[87228]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] allow_compression_on_image_upload = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] allowed_direct_url_schemes = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] api_rate_limit = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] auth_strategy = keystone {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_availability_zone = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_host = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_stats_polling_interval = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backup_api_class = cinder.backup.api.API {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backup_name_template = backup-%s {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backup_use_same_host = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backup_use_temp_snapshot = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] chap_password = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] chap_username = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_internal_tenant_project_id = 25525080a5304cd480986eee2829b5ca {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_internal_tenant_user_id = 5cc12dff78764b499f57932e15a8c131 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cluster = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] compression_format = gzip {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] compute_api_class = cinder.compute.nova.API {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] config_dir = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] config_source = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] control_exchange = openstack {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] debug = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] default_availability_zone = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] default_group_type = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] default_volume_type = QuobyteHD {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] disk_geometry = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] driver_client_cert = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] driver_client_cert_key = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] driver_data_namespace = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] driver_ssl_cert_path = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] driver_ssl_cert_verify = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] driver_use_ssl = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] enable_new_services = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] enable_unsupported_driver = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] enabled_backends = ['QuobyteHD'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] enforce_multipath_for_image_xfer = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] filter_function = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_api_insecure = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_api_servers = ['http://192.168.122.177/image'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_api_ssl_compression = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_ca_certificates_file = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_catalog_info = image:glance:publicURL {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_certfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_keyfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_num_retries = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance_request_timeout = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] goodness_function = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] graceful_shutdown_timeout = 5 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] group_api_class = cinder.group.api.API {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] host = devstack {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_compress_on_upload = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_conversion_address_space_limit = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_conversion_cpu_limit = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_conversion_disable = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_upload_use_cinder_backend = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_upload_use_internal_tenant = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_volume_cache_enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_volume_cache_max_count = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] image_volume_cache_max_size_gb = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] init_host_max_objects_retrieval = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] instance_format = [instance: %(uuid)s] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] iscsi_target_flags = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] iscsi_write_cache = on {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87228) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] iser_helper = tgtadm {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] iser_ip_address = 192.168.122.177 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] iser_port = 3260 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_color = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_config_append = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_dir = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_file = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_options = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_rotate_interval = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_rotate_interval_type = days {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] log_rotation_type = none {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] max_age = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] max_logfile_count = 30 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] max_logfile_size_mb = 200 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] max_over_subscription_ratio = 20.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] message_reap_interval = 86400 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] message_ttl = 2592000 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] migration_create_volume_timeout_secs = 300 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] monkey_patch = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] monkey_patch_modules = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] my_ip = 192.168.122.177 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] no_snapshot_gb_quota = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] num_iser_scan_tries = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] num_shell_tries = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] num_volume_device_scan_tries = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] nvmeof_conn_info_version = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] nvmet_ns_id = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] nvmet_port_id = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] osapi_max_limit = 1000 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] osapi_volume_ext_list = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] osapi_volume_listen = 0.0.0.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] osapi_volume_listen_port = 8776 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] osapi_volume_use_ssl = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] osapi_volume_workers = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] per_volume_size_limit = -1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] periodic_fuzzy_delay = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] periodic_interval = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] project_id_regex = [0-9a-f\-]+ {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] public_endpoint = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] publish_errors = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] quota_backup_gigabytes = 1000 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] quota_backups = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] quota_gigabytes = 1000 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] quota_groups = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] quota_snapshots = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] quota_volumes = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] rate_limit_burst = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] rate_limit_except_level = CRITICAL {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] rate_limit_interval = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] reinit_driver_count = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] replication_device = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] report_discard_supported = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] report_interval = 120 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] reservation_clean_interval = 86400 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] reservation_expire = 86400 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] reserved_image_namespaces = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] reserved_percentage = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] rpc_response_timeout = 120 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] run_external_periodic_tasks = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] scst_target_driver = iscsi {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] scst_target_iqn_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_down_time = 720 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] shell_completion = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] snapshot_name_template = snapshot-%s {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] split_loggers = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] state_path = /opt/stack/data/cinder {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] storage_availability_zone = nova {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] storage_protocol = iSCSI {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] syslog_log_facility = LOG_USER {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] target_helper = lioadm {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] target_ip_address = 192.168.122.177 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] target_port = 3260 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] target_protocol = iscsi {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] target_secondary_ip_addresses = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] trace_flags = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] transfer_api_class = cinder.transfer.api.API {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] transport_url = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] until_refresh = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] use_chap_auth = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] use_default_quota_class = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] use_journal = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] use_json = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] use_multipath_for_image_xfer = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] use_stderr = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87228) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] use_syslog = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] verify_glance_signatures = enabled {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Running cmd (subprocess): mount.quobyte {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_api_class = cinder.volume.api.API {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_backend_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_clear = zero {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_clear_ionice = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_clear_size = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_copy_bps_limit = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_dd_blocksize = 1M {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_name_template = volume-%s {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_service_inithost_offload = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volume_usage_audit_period = month {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] zoning_mode = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_concurrency.disable_process_locking = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.auth_section = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.auth_type = password {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.auth_version = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.cache = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.certfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.delay_auth_decision = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.http_connect_timeout = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.include_service_catalog = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.insecure = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.interface = public {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.keyfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_password = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcache_username = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.region_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.service_token_roles_required = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.service_type = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.token_cache_time = 300 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.177/identity {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.backend = dogpile.cache.null {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.backend_argument = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.backend_expiration_time = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.config_prefix = cache.oslo {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.debug_cache_backend = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.enable_retry_client = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.enable_socket_keepalive = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.expiration_time = 600 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.hashclient_retry_attempts = 2 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.memcache_dead_retry = 300 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.memcache_pool_maxsize = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.memcache_sasl_enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.password = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.proxies = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.redis_db = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.redis_sentinel_service_name = mymaster {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.redis_server = localhost:6379 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.retry_attempts = 2 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.retry_delay = 0.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.socket_keepalive_count = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.socket_keepalive_idle = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.socket_keepalive_interval = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.socket_timeout = 1.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.tls_allowed_ciphers = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.tls_cafile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.tls_certfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.tls_enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.tls_keyfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cache.username = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.asyncio_connection = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.asyncio_slave_connection = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.backend = sqlalchemy {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.connection = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.connection_debug = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.connection_parameters = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.connection_recycle_time = 3600 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.connection_trace = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.db_inc_retry_interval = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.db_max_retries = 20 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.db_max_retry_interval = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.db_retry_interval = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.max_overflow = 50 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.max_pool_size = 5 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.max_retries = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.mysql_wsrep_sync_wait = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.pool_timeout = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.retry_interval = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.slave_connection = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.sqlite_synchronous = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.synchronous_reader = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] database.use_db_reconnect = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.connection_string = messaging:// {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.es_doc_type = notification {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.es_scroll_size = 10000 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.es_scroll_time = 2m {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.filter_error_trace = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.hmac_keys = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.sentinel_service_name = mymaster {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.socket_timeout = 0.1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.trace_requests = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler.trace_sqlalchemy = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler_jaeger.process_tags = {} {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler_jaeger.service_name_prefix = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] profiler_otlp.service_name_prefix = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.enforce_new_defaults = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.enforce_scope = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.policy_default_rule = default {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.policy_file = policy.yaml {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_policy.remote_timeout = 60.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] coordination.backend_url = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] privsep_osbrick.group = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] privsep_osbrick.helper_command = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] privsep_osbrick.user = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_sys_admin.group = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_sys_admin.helper_command = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] cinder_sys_admin.user = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.auth_section = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.auth_type = password {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.cafile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.certfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.collect_timing = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.insecure = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.keyfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.send_service_user_token = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.split_loggers = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] service_user.timeout = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.auth_section = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.auth_type = password {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.certfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.collect_timing = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.insecure = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.keyfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.region_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.split_loggers = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] glance.timeout = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.backend_availability_zone = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.chap_password = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.chap_username = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.disk_geometry = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.driver_client_cert = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.driver_client_cert_key = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.driver_data_namespace = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.driver_use_ssl = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.enable_unsupported_driver = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.extra_capabilities = {} {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.filter_function = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.goodness_function = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.iscsi_target_flags = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.iscsi_write_cache = on {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.iser_helper = tgtadm {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.iser_ip_address = 192.168.122.177 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.iser_port = 3260 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack quobyte-client[87229]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 17:47:21 devstack quobyte-client[87229]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_host = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_login = admin {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_mount_options = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_password = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_private_key = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_share_path = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_ssh_port = 22 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.num_shell_tries = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.nvmet_port_id = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.quobyte_client_cfg = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.quobyte_volume_url = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.replication_device = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.report_discard_supported = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.reserved_percentage = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.scst_target_driver = iscsi {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.scst_target_iqn_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.storage_protocol = iSCSI {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.target_helper = tgtadm {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.target_ip_address = 192.168.122.177 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.target_port = 3260 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.target_protocol = iscsi {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.trace_flags = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.unique_fqdn_network = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.use_chap_auth = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volume_backend_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volume_clear = zero {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volume_clear_ionice = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volume_clear_size = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_reports.file_event_handler = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_reports.log_dir = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.backend_availability_zone = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.backend_host = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.chap_password = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.chap_username = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.chiscsi_conf = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.disk_geometry = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.driver_client_cert = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.driver_client_cert_key = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.driver_data_namespace = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.driver_use_ssl = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.extra_capabilities = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.filter_function = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.goodness_function = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.iscsi_target_flags = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.iscsi_write_cache = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.iser_helper = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.iser_ip_address = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.iser_port = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.iser_target_prefix = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_host = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_login = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_mount_options = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_password = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_private_key = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_share_path = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_ssh_port = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.num_shell_tries = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nvmet_ns_id = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.nvmet_port_id = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.replication_device = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.report_discard_supported = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.reserved_percentage = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.scst_target_driver = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.storage_protocol = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.target_helper = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.target_ip_address = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.target_port = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.target_prefix = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.target_protocol = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.trace_flags = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.unique_fqdn_network = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.use_chap_auth = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volume_clear = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volume_clear_ionice = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volume_clear_size = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] QuobyteHD.volumes_dir = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.ssl = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.ssl_version = {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_notifications.driver = [] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_notifications.retry = -1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] oslo_messaging_notifications.transport_url = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] key_manager.fixed_key = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.barbican_api_version = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.barbican_endpoint = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.barbican_endpoint_type = public {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.barbican_region_name = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.cafile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.certfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.collect_timing = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.insecure = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.keyfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.number_of_retries = 60 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.retry_delay = 1 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.send_service_user_token = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.split_loggers = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.timeout = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.verify_ssl = True {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican.verify_ssl_path = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.auth_section = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.auth_type = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.cafile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.certfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.collect_timing = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.insecure = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.keyfile = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.split_loggers = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] barbican_service_user.timeout = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.approle_role_id = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.approle_secret_id = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.kv_mountpoint = secret {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.kv_path = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.kv_version = 2 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.namespace = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.root_token_id = **** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.ssl_ca_crt_file = None {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.timeout = 60.0 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.use_ssl = False {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:47:21 devstack cinder-volume[86975]: DEBUG oslo_service.backend._eventlet.service [None req-abb7d538-66a2-4908-a12a-a87185e25aed None None] ******************************************************************************** {{(pid=86975) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:47:22 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.630s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:22 devstack cinder-volume[87228]: INFO cinder.volume.driver [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG cinder.volume.driver [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.690715789795, 'free_capacity_gb': 1775.690715789795, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87228) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG oslo_db.sqlalchemy.engines [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writer thread running {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG cinder.db.sqlalchemy.api [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Building query based on filter {{(pid=87228) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87228) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:22 devstack cinder-volume[87228]: INFO cinder.keymgr.migration [None req-f30e67c6-875c-4687-bd4a-2266c7837c06 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:47:22 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:47:22 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:22 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.636s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:22 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:47:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Driver initialization completed successfully. Jul 07 17:47:23 devstack cinder-volume[87228]: INFO cinder.manager [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Initiating service 3 cleanup Jul 07 17:47:23 devstack cinder-volume[87228]: INFO cinder.manager [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Service 3 cleanup completed. Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG cinder.service [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Creating RPC server for service cinder-volume {{(pid=87228) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG cinder.service [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87228) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:47:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:47:23 devstack sudo[87242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:47:23 devstack sudo[87242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:47:23 devstack sudo[87242]: pam_unix(sudo:session): session closed for user root Jul 07 17:47:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.607s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:47:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b92fd77b-1984-4b15-9054-bbca20b069b7 None None] Driver post RPC initialization completed successfully. Jul 07 17:47:31 devstack cinder-volume[86975]: DEBUG dbcounter [-] [86975] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86975) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:47:33 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:47:33 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:48:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:48:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:48:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:48:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:23 devstack sudo[87530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:48:23 devstack sudo[87530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:24 devstack sudo[87530]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.990s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:48:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:48:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 6 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:48:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:48:38 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:48:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Flow 'volume_create_manager' (a7462a23-1096-4132-8835-b0be17ff4b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:48:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cc74bc-2fd7-4d8b-bef0-f136fa6bd9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cc74bc-2fd7-4d8b-bef0-f136fa6bd9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1506385131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbe1123-e63d-4385-9a60-d832962f7404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf988856877426e93e339f2ed46937c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:48:38Z,use_quota=True,user_id='44c12e5fa70943aaa772bf5833645288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e67cca-056a-42af-a428-16b8068f5513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e67cca-056a-42af-a428-16b8068f5513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7849e189-632b-4385-a283-12ad07eb225c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7849e189-632b-4385-a283-12ad07eb225c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccbe1123-e63d-4385-9a60-d832962f7404', 'volume_name': 'volume-ccbe1123-e63d-4385-9a60-d832962f7404', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bc354c-1d9f-499f-a11a-3e080b3b71a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bc354c-1d9f-499f-a11a-3e080b3b71a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567f1555-69f5-4580-a474-7549d5a4e0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:39 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Volume ccbe1123-e63d-4385-9a60-d832962f7404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccbe1123-e63d-4385-9a60-d832962f7404', 'volume_size': 1} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1506385131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbe1123-e63d-4385-9a60-d832962f7404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf988856877426e93e339f2ed46937c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:48:38Z,use_quota=True,user_id='44c12e5fa70943aaa772bf5833645288',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Creating volume ccbe1123-e63d-4385-9a60-d832962f7404 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:48:39 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:48:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:39 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 1073741824 Jul 07 17:48:39 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:41 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 1073741824" returned: 0 in 2.229s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:41 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 Jul 07 17:48:41 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:43 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404" returned: 0 in 1.629s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] <== create_volume: return (4018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:48:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.023s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567f1555-69f5-4580-a474-7549d5a4e0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccbe1123-e63d-4385-9a60-d832962f7404', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11f5f32-49b6-42f8-918e-d2a880031f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:43 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Volume volume-ccbe1123-e63d-4385-9a60-d832962f7404 (ccbe1123-e63d-4385-9a60-d832962f7404): created successfully Jul 07 17:48:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11f5f32-49b6-42f8-918e-d2a880031f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Flow 'volume_create_manager' (a7462a23-1096-4132-8835-b0be17ff4b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:48:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-300efd0a-bf92-485b-83d9-f4046cdea029 tempest-DeleteServersTestJSON-14772682 None] Created volume successfully. Jul 07 17:48:51 devstack cinder-volume[87228]: WARNING py.warnings [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 07 17:48:51 devstack cinder-volume[87228]: .first() Jul 07 17:48:51 devstack cinder-volume[87228]: Jul 07 17:48:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:51 devstack cinder-volume[87228]: INFO oslo.privsep.daemon [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp32p9fjvq/privsep.sock'] Jul 07 17:48:51 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp32p9fjvq/privsep.sock Jul 07 17:48:51 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:48:52 devstack cinder-volume[87228]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 17:48:53 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:53 devstack cinder-volume[87228]: INFO oslo.privsep.daemon [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] Spawned new privsep daemon via rootwrap Jul 07 17:48:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] Accepted privsep connection to /tmp/tmp32p9fjvq/privsep.sock {{(pid=87228) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 17:48:53 devstack cinder-volume[87228]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 17:48:53 devstack cinder-volume[87228]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 17:48:53 devstack cinder-volume[87228]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 17:48:53 devstack cinder-volume[87228]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88283 Jul 07 17:48:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa654836-9217-4d46-944c-1c1b7e522cb2]: (2,) {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c1c483-8644-4689-9edd-902bb94fd8f4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:48:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:53 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:48:53 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 Jul 07 17:48:53 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:48:54 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Jul 07 17:48:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404" returned: 0 in 1.203s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:48:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.117s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-ccbe1123-e63d-4385-9a60-d832962f7404', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baccad5b-426c-421c-bc03-d687467baaf2', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:48:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-5cad5751-1511-4ef7-bb0d-8c9fad447cf8 req-75f6fa6d-0d38-4051-ad6e-49253282acd4 tempest-DeleteServersTestJSON-14772682 None] attachment_update completed successfully. Jul 07 17:48:58 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Flow 'volume_create_manager' (255857fa-8a36-499e-8da8-0db7ddf5e83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb9defd-fc7f-464c-b36c-4631d5da00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb9defd-fc7f-464c-b36c-4631d5da00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-721851400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180cd28a-c2ac-4a2b-bad9-e6e834ec8523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bb00cfccb54af4aead2d9133430be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:48:59Z,use_quota=True,user_id='af492ac45eed43c6a7f6edb20eb0d685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c945c3-500d-4b60-a945-ee79973fb3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c945c3-500d-4b60-a945-ee79973fb3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15224340-249d-4471-a13e-ca77e82ae6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15224340-249d-4471-a13e-ca77e82ae6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '180cd28a-c2ac-4a2b-bad9-e6e834ec8523', 'volume_name': 'volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ade265-ef26-4995-ba11-cac766885947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ade265-ef26-4995-ba11-cac766885947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eae075-8090-48cc-bf61-fc799d628c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:48:59 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Volume 180cd28a-c2ac-4a2b-bad9-e6e834ec8523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523', 'volume_size': 1} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-721851400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180cd28a-c2ac-4a2b-bad9-e6e834ec8523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23bb00cfccb54af4aead2d9133430be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:48:59Z,use_quota=True,user_id='af492ac45eed43c6a7f6edb20eb0d685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Creating volume 180cd28a-c2ac-4a2b-bad9-e6e834ec8523 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:48:59 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:48:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:48:59 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 1073741824 Jul 07 17:48:59 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:00 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 1073741824" returned: 0 in 1.676s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:00 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 Jul 07 17:49:00 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:01 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523" returned: 0 in 0.793s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] <== create_volume: return (2543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:49:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.545s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eae075-8090-48cc-bf61-fc799d628c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1dfc45-0f11-45be-91fc-b8480785d691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:01 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Volume volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 (180cd28a-c2ac-4a2b-bad9-e6e834ec8523): created successfully Jul 07 17:49:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1dfc45-0f11-45be-91fc-b8480785d691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Flow 'volume_create_manager' (255857fa-8a36-499e-8da8-0db7ddf5e83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:01 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0d1a8d00-aab4-47b3-a2dd-c0cc1771e32c tempest-VolumesAdminNegativeTest-848985777 None] Created volume successfully. Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Acquiring lock "cinder-180cd28a-c2ac-4a2b-bad9-e6e834ec8523-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Lock "cinder-180cd28a-c2ac-4a2b-bad9-e6e834ec8523-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Acquiring lock "cinder-quobyte-180cd28a-c2ac-4a2b-bad9-e6e834ec8523" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Flow 'volume_create_manager' (03103af0-74b7-418b-bcb6-fa06f6409216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e949de-d943-416f-87c0-891b859e38ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Lock "cinder-quobyte-180cd28a-c2ac-4a2b-bad9-e6e834ec8523" acquired by "delete_volume" :: waited 0.115s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e949de-d943-416f-87c0-891b859e38ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1500211255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02f322b-ff4b-4b4c-a465-48de15c6ae40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2198b643d6134782a5f204efde338ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:49:04Z,use_quota=True,user_id='1a9c0b7fc6764c6d81742ae4a08c8e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdd5791-b6ac-4a71-a78c-7db40cc30c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdd5791-b6ac-4a71-a78c-7db40cc30c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ea4b7e-add7-45a3-b03f-43a8420fd9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ea4b7e-add7-45a3-b03f-43a8420fd9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f02f322b-ff4b-4b4c-a465-48de15c6ae40', 'volume_name': 'volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb5dc0b2-3bd4-4075-87ee-45f148a51e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb5dc0b2-3bd4-4075-87ee-45f148a51e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3546b45-a105-40a9-9650-08b7153d0d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:04 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Volume f02f322b-ff4b-4b4c-a465-48de15c6ae40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40', 'volume_size': 1} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1500211255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f02f322b-ff4b-4b4c-a465-48de15c6ae40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2198b643d6134782a5f204efde338ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:49:04Z,use_quota=True,user_id='1a9c0b7fc6764c6d81742ae4a08c8e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Creating volume f02f322b-ff4b-4b4c-a465-48de15c6ae40 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:49:04 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4e77e4-f29a-490a-91d8-4d745b61e2d3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:04 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 1073741824 Jul 07 17:49:04 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:04 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 Jul 07 17:49:04 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:05 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523" returned: 0 in 1.146s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:05 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523 Jul 07 17:49:05 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:05 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 1073741824" returned: 0 in 1.761s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:05 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 Jul 07 17:49:05 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:06 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-180cd28a-c2ac-4a2b-bad9-e6e834ec8523" returned: 0 in 1.684s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Lock "cinder-quobyte-180cd28a-c2ac-4a2b-bad9-e6e834ec8523" released by "delete_volume" :: held 3.002s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:07 devstack cinder-volume[87228]: WARNING cinder.quota [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:49:07 devstack cinder-volume[87228]: WARNING cinder.quota [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Created reservations ['8f7eaba9-aa66-46a5-a492-83150d188ca6', '8ff11f32-b5f8-45ce-8f5c-afacd3e2dd6b', 'aca9d361-15c5-4727-b798-ff434b35abe9', 'e8cec5b9-1cfb-4c8f-a734-07ae3dd1842c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:49:07 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40" returned: 0 in 1.416s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] <== create_volume: return (3252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.256s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3546b45-a105-40a9-9650-08b7153d0d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87ce63e-5ef0-411f-adf6-0644c7d4cf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:07 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Volume volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 (f02f322b-ff4b-4b4c-a465-48de15c6ae40): created successfully Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a87ce63e-5ef0-411f-adf6-0644c7d4cf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Flow 'volume_create_manager' (03103af0-74b7-418b-bcb6-fa06f6409216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:07 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:49:07 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f0cfa874-146a-4021-a6e9-978dc52a78ff tempest-AttachVolumeNegativeTest-12418647 None] Created volume successfully. Jul 07 17:49:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-9e0bb9fc-924c-46dc-a47d-3eeefd140e2c req-8e2cf8de-010c-4f68-b41f-79deb5ee1efe tempest-DeleteServersTestJSON-14772682 None] Terminate volume connection completed successfully. Jul 07 17:49:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-9e0bb9fc-924c-46dc-a47d-3eeefd140e2c req-8e2cf8de-010c-4f68-b41f-79deb5ee1efe tempest-DeleteServersTestJSON-14772682 None] Deleting attachment baccad5b-426c-421c-bc03-d687467baaf2. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:49:08 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.066s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:08 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:49:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Deleted volume successfully. Jul 07 17:49:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6d416c74-d822-42d0-bfc4-8809de2bbef3 tempest-VolumesAdminNegativeTest-848985777 None] Lock "cinder-180cd28a-c2ac-4a2b-bad9-e6e834ec8523-delete_volume" released by "delete_volume" :: held 4.859s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Acquiring lock "cinder-ccbe1123-e63d-4385-9a60-d832962f7404-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Lock "cinder-ccbe1123-e63d-4385-9a60-d832962f7404-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Acquiring lock "cinder-quobyte-ccbe1123-e63d-4385-9a60-d832962f7404" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:49:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Lock "cinder-quobyte-ccbe1123-e63d-4385-9a60-d832962f7404" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:49:12 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6432b38-bb79-4c67-b365-8df8ccc5b2c4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:12 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 Jul 07 17:49:12 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-119ca177-3218-4bc5-ae4e-061b22a4446f req-361133f2-13df-4aed-baba-e3f9c84bf534 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-119ca177-3218-4bc5-ae4e-061b22a4446f req-361133f2-13df-4aed-baba-e3f9c84bf534 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:12 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ef23f3-12d3-494f-86fc-26efcac73cd1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:49:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-119ca177-3218-4bc5-ae4e-061b22a4446f req-361133f2-13df-4aed-baba-e3f9c84bf534 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:12 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 Jul 07 17:49:12 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:13 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404" returned: 0 in 1.035s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:13 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404 Jul 07 17:49:13 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:13 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-119ca177-3218-4bc5-ae4e-061b22a4446f req-361133f2-13df-4aed-baba-e3f9c84bf534 tempest-AttachVolumeNegativeTest-12418647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40" returned: 0 in 0.912s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-119ca177-3218-4bc5-ae4e-061b22a4446f req-361133f2-13df-4aed-baba-e3f9c84bf534 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.937s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-119ca177-3218-4bc5-ae4e-061b22a4446f req-361133f2-13df-4aed-baba-e3f9c84bf534 tempest-AttachVolumeNegativeTest-12418647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b66bfe23-d05e-4e16-bb3a-15ecb02eb036', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:49:13 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-119ca177-3218-4bc5-ae4e-061b22a4446f req-361133f2-13df-4aed-baba-e3f9c84bf534 tempest-AttachVolumeNegativeTest-12418647 None] attachment_update completed successfully. Jul 07 17:49:13 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ccbe1123-e63d-4385-9a60-d832962f7404" returned: 0 in 0.873s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Lock "cinder-quobyte-ccbe1123-e63d-4385-9a60-d832962f7404" released by "delete_volume" :: held 1.986s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Created reservations ['6315a0a8-8f97-4d01-82ac-87de4fdb72b1', '45ee36cb-97f7-478f-bc3e-89292f70fe99', '4ce6504d-e939-43fe-a1ca-919b1385c6d7', '2e75ea7a-799a-45ad-abfb-175a307a5504'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:14 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:49:14 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:14 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.776s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:14 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:49:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Deleted volume successfully. Jul 07 17:49:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1cdb19e7-8ea4-472c-8a2a-b3fe11b69a73 tempest-DeleteServersTestJSON-14772682 None] Lock "cinder-ccbe1123-e63d-4385-9a60-d832962f7404-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:49:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:49:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:23 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:49:23 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:24 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.911s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:49:24 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=25,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Flow 'volume_create_manager' (0d3401f4-84a8-4689-8a3f-9cf1142dc077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dc6d51-426c-4102-a1d2-89089abdcec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dc6d51-426c-4102-a1d2-89089abdcec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1836915128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272ea03d-5e3e-4e8d-8243-6e37e2025e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7ed071111f4f2ead52b2e3e857fc81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:49:27Z,use_quota=True,user_id='46e63da4fefb4d63b3acdc07054e9117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfd334e-6f8d-490f-bdfd-656cf6122396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfd334e-6f8d-490f-bdfd-656cf6122396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf6fc9d-68b4-4967-80bc-067d4abbf5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf6fc9d-68b4-4967-80bc-067d4abbf5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '272ea03d-5e3e-4e8d-8243-6e37e2025e65', 'volume_name': 'volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea950f6b-d435-498c-a087-9b7dfc5f6e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea950f6b-d435-498c-a087-9b7dfc5f6e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62c342a-b056-4d84-92b0-7c1d595984e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:27 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Volume 272ea03d-5e3e-4e8d-8243-6e37e2025e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65', 'volume_size': 1} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1836915128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272ea03d-5e3e-4e8d-8243-6e37e2025e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc7ed071111f4f2ead52b2e3e857fc81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:49:27Z,use_quota=True,user_id='46e63da4fefb4d63b3acdc07054e9117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Creating volume 272ea03d-5e3e-4e8d-8243-6e37e2025e65 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:49:27 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:49:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:27 devstack sudo[89299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 1073741824 Jul 07 17:49:27 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:28 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 1073741824" returned: 0 in 1.390s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:49:28 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 Jul 07 17:49:28 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:49:29 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Jul 07 17:49:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65" returned: 0 in 0.845s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:49:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:49:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.306s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:49:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62c342a-b056-4d84-92b0-7c1d595984e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91fbe8-bc9b-475d-b3ca-9b6ce9f5f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:49:29 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Volume volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 (272ea03d-5e3e-4e8d-8243-6e37e2025e65): created successfully Jul 07 17:49:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e91fbe8-bc9b-475d-b3ca-9b6ce9f5f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:49:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Flow 'volume_create_manager' (0d3401f4-84a8-4689-8a3f-9cf1142dc077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:49:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f13acf9c-bc45-42b0-baf6-bd720a65e830 tempest-TaggedAttachmentsTest-1059768874 None] Created volume successfully. Jul 07 17:49:39 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=32,cinder:UPDATE=31,cinder:INSERT=7 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:49:39 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:50:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:50:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:50:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:50:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:50:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:50:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:50:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:50:23 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:50:23 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:50:25 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Jul 07 17:50:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.773s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:50:25 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:50:25 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:50:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 8 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:50:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:50:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-be97d6db-8881-4b79-a0ee-87cf13bf72fb req-0556616e-b539-412d-beca-6487cd3c21aa tempest-AttachVolumeNegativeTest-12418647 None] Terminate volume connection completed successfully. Jul 07 17:50:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-be97d6db-8881-4b79-a0ee-87cf13bf72fb req-0556616e-b539-412d-beca-6487cd3c21aa tempest-AttachVolumeNegativeTest-12418647 None] Deleting attachment b66bfe23-d05e-4e16-bb3a-15ecb02eb036. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Flow 'volume_create_manager' (1794782b-defa-4366-b8a1-5dd13d3409cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a708981-798e-414d-a88e-7da99cae3388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a708981-798e-414d-a88e-7da99cae3388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1803966700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98b43da-5d94-4fc4-8ce3-bc36fd029d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef2e2ca2090467cb432267a4eeb1e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:50:33Z,use_quota=True,user_id='9e69760c65314129aaaa821dbedab23c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a38b85a-e820-4495-a0ff-5f6eeb190daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a38b85a-e820-4495-a0ff-5f6eeb190daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adda31b-483e-4a76-a85f-91c561410d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adda31b-483e-4a76-a85f-91c561410d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98b43da-5d94-4fc4-8ce3-bc36fd029d99', 'volume_name': 'volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07807b6-07cc-41dc-9441-6b1d9dd9e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07807b6-07cc-41dc-9441-6b1d9dd9e925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7d29a4-6c96-4bba-815c-5ac0a3334812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:32 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Volume a98b43da-5d94-4fc4-8ce3-bc36fd029d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99', 'volume_size': 1} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1803966700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98b43da-5d94-4fc4-8ce3-bc36fd029d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef2e2ca2090467cb432267a4eeb1e24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:50:33Z,use_quota=True,user_id='9e69760c65314129aaaa821dbedab23c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Creating volume a98b43da-5d94-4fc4-8ce3-bc36fd029d99 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:50:32 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:50:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:50:33 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 1073741824 Jul 07 17:50:33 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:50:35 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Jul 07 17:50:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 1073741824" returned: 0 in 2.746s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:50:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:50:35 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 Jul 07 17:50:35 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:50:37 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Jul 07 17:50:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99" returned: 0 in 1.463s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:50:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] <== create_volume: return (4293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:50:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.296s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:50:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7d29a4-6c96-4bba-815c-5ac0a3334812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b479d5be-942a-4da8-aacc-614671bf3878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:37 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Volume volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 (a98b43da-5d94-4fc4-8ce3-bc36fd029d99): created successfully Jul 07 17:50:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b479d5be-942a-4da8-aacc-614671bf3878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Flow 'volume_create_manager' (1794782b-defa-4366-b8a1-5dd13d3409cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:50:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-415a3df9-63d9-4b64-8406-abb07b33c7cc tempest-ServerRescueNegativeTestJSON-1927527589 None] Created volume successfully. Jul 07 17:50:47 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:50:47 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:50:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-dfb10d59-f18a-43b9-8da8-0d156e93545d req-7eba8043-2b7a-4204-85e0-397427f2a903 tempest-TaggedAttachmentsTest-1059768874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:50:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-dfb10d59-f18a-43b9-8da8-0d156e93545d req-7eba8043-2b7a-4204-85e0-397427f2a903 tempest-TaggedAttachmentsTest-1059768874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:50:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ef96cc-c04c-445a-8440-38ec6fe1a290]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:50:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-dfb10d59-f18a-43b9-8da8-0d156e93545d req-7eba8043-2b7a-4204-85e0-397427f2a903 tempest-TaggedAttachmentsTest-1059768874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:50:54 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 Jul 07 17:50:54 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:50:55 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-dfb10d59-f18a-43b9-8da8-0d156e93545d req-7eba8043-2b7a-4204-85e0-397427f2a903 tempest-TaggedAttachmentsTest-1059768874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65" returned: 0 in 1.489s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-dfb10d59-f18a-43b9-8da8-0d156e93545d req-7eba8043-2b7a-4204-85e0-397427f2a903 tempest-TaggedAttachmentsTest-1059768874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.523s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-dfb10d59-f18a-43b9-8da8-0d156e93545d req-7eba8043-2b7a-4204-85e0-397427f2a903 tempest-TaggedAttachmentsTest-1059768874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3efd0f4a-0e81-4719-a9ed-a2d0b3c8d64d', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:50:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-dfb10d59-f18a-43b9-8da8-0d156e93545d req-7eba8043-2b7a-4204-85e0-397427f2a903 tempest-TaggedAttachmentsTest-1059768874 None] attachment_update completed successfully. Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Flow 'volume_create_manager' (189bc88b-f14c-43be-b9c0-51a295297fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f94062-d313-4e68-b56d-fa973a323eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f94062-d313-4e68-b56d-fa973a323eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1584414953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bf3ceb-00a2-41ab-a309-c3762292b642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30569908dda8471fa2abd481258b8e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:50:55Z,use_quota=True,user_id='eb2a070b76184ac5955d17f97f4d8e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17eb70d0-17c4-410d-a298-9928f48b8c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17eb70d0-17c4-410d-a298-9928f48b8c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fb5705-57f2-4f10-b21a-5773a00e995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fb5705-57f2-4f10-b21a-5773a00e995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25bf3ceb-00a2-41ab-a309-c3762292b642', 'volume_name': 'volume-25bf3ceb-00a2-41ab-a309-c3762292b642', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d51102-a008-4c08-8662-8ecf7d25dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d51102-a008-4c08-8662-8ecf7d25dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dda54df-ab39-4a3a-b3b7-cae8ead22765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:55 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Volume 25bf3ceb-00a2-41ab-a309-c3762292b642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25bf3ceb-00a2-41ab-a309-c3762292b642', 'volume_size': 1} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1584414953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25bf3ceb-00a2-41ab-a309-c3762292b642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30569908dda8471fa2abd481258b8e65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:50:55Z,use_quota=True,user_id='eb2a070b76184ac5955d17f97f4d8e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Creating volume 25bf3ceb-00a2-41ab-a309-c3762292b642 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:50:55 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:50:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:50:55 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 1073741824 Jul 07 17:50:55 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:50:57 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Jul 07 17:50:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 1073741824" returned: 0 in 1.397s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:50:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:50:57 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 Jul 07 17:50:57 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:50:58 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642" returned: 0 in 1.071s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] <== create_volume: return (2527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.531s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dda54df-ab39-4a3a-b3b7-cae8ead22765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25bf3ceb-00a2-41ab-a309-c3762292b642', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9432d4-77cd-48dd-ae61-163c0fd0060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:50:58 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Volume volume-25bf3ceb-00a2-41ab-a309-c3762292b642 (25bf3ceb-00a2-41ab-a309-c3762292b642): created successfully Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9432d4-77cd-48dd-ae61-163c0fd0060f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Flow 'volume_create_manager' (189bc88b-f14c-43be-b9c0-51a295297fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:50:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8981f44b-d4ae-4a6a-9d84-4fe2c5e9e759 tempest-ServerActionsTestOtherA-1914570287 None] Created volume successfully. Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Acquiring lock "cinder-a98b43da-5d94-4fc4-8ce3-bc36fd029d99-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "cinder-a98b43da-5d94-4fc4-8ce3-bc36fd029d99-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Acquiring lock "cinder-quobyte-a98b43da-5d94-4fc4-8ce3-bc36fd029d99" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "cinder-quobyte-a98b43da-5d94-4fc4-8ce3-bc36fd029d99" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1427599d-655c-4017-aee4-f1f516ce0ee5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:50:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:50:58 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 Jul 07 17:50:58 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:00 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99" returned: 0 in 1.373s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:00 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99 Jul 07 17:51:00 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:01 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a98b43da-5d94-4fc4-8ce3-bc36fd029d99" returned: 0 in 1.307s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "cinder-quobyte-a98b43da-5d94-4fc4-8ce3-bc36fd029d99" released by "delete_volume" :: held 2.732s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Created reservations ['f5f526ee-5679-4c96-aea5-45ae1e05b671', '57521a7d-96b9-41c9-8438-29961fe92d4d', '47c67a03-6230-4865-95b0-0155d63c7b33', '9b8aee65-f1da-44c3-a9b1-577025541bd5'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:01 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:51:01 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:03 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.388s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:03 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:51:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Deleted volume successfully. Jul 07 17:51:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692c3812-a672-49cd-999e-3ffc6286d163 tempest-ServerRescueNegativeTestJSON-1927527589 None] Lock "cinder-a98b43da-5d94-4fc4-8ce3-bc36fd029d99-delete_volume" released by "delete_volume" :: held 4.495s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:51:05 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-d567a3c2-0790-4549-b3d0-7e68cd1e7067 req-d4f56952-e40d-484d-b6f5-1f87c635aafb tempest-TaggedAttachmentsTest-1059768874 None] Terminate volume connection completed successfully. Jul 07 17:51:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-d567a3c2-0790-4549-b3d0-7e68cd1e7067 req-d4f56952-e40d-484d-b6f5-1f87c635aafb tempest-TaggedAttachmentsTest-1059768874 None] Deleting attachment 3efd0f4a-0e81-4719-a9ed-a2d0b3c8d64d. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:51:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:51:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:51:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:51:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:23 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:51:23 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:24 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.028s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:51:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Acquiring lock "cinder-272ea03d-5e3e-4e8d-8243-6e37e2025e65-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:51:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Lock "cinder-272ea03d-5e3e-4e8d-8243-6e37e2025e65-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:51:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Acquiring lock "cinder-quobyte-272ea03d-5e3e-4e8d-8243-6e37e2025e65" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:51:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Lock "cinder-quobyte-272ea03d-5e3e-4e8d-8243-6e37e2025e65" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:51:27 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010f441-9f2f-41a3-afcf-8fe6247db8af]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:51:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:28 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 Jul 07 17:51:28 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:29 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65" returned: 0 in 1.182s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:29 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65 Jul 07 17:51:29 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Flow 'volume_create_manager' (48d4cec2-57a9-4914-811a-c0889bf1025a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823190fe-0a2f-4bee-a5ef-5c884d8c0708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823190fe-0a2f-4bee-a5ef-5c884d8c0708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-610430500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d894815-8d54-45c5-b67f-d87c4af01325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2198b643d6134782a5f204efde338ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:51:29Z,use_quota=True,user_id='1a9c0b7fc6764c6d81742ae4a08c8e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535f1dd9-c492-4e84-9e27-8133d447a297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535f1dd9-c492-4e84-9e27-8133d447a297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6085434-dc0a-42a4-89cd-570433394237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6085434-dc0a-42a4-89cd-570433394237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d894815-8d54-45c5-b67f-d87c4af01325', 'volume_name': 'volume-4d894815-8d54-45c5-b67f-d87c4af01325', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b50e1d-7892-44ca-a87c-c42e911c79a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b50e1d-7892-44ca-a87c-c42e911c79a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c81ea6d-cda6-4c57-a854-c3486204d152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:29 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Volume 4d894815-8d54-45c5-b67f-d87c4af01325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d894815-8d54-45c5-b67f-d87c4af01325', 'volume_size': 1} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-610430500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d894815-8d54-45c5-b67f-d87c4af01325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2198b643d6134782a5f204efde338ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:51:29Z,use_quota=True,user_id='1a9c0b7fc6764c6d81742ae4a08c8e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Creating volume 4d894815-8d54-45c5-b67f-d87c4af01325 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:51:29 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:51:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:29 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 1073741824 Jul 07 17:51:29 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:30 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-272ea03d-5e3e-4e8d-8243-6e37e2025e65" returned: 0 in 1.022s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Lock "cinder-quobyte-272ea03d-5e3e-4e8d-8243-6e37e2025e65" released by "delete_volume" :: held 2.271s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Created reservations ['35fdb74e-ad80-4e7d-b8d1-3b3f6ef6ad9b', 'b735225c-8962-498d-aed6-89590d932bee', '40f012f0-cbc5-41b0-a874-c83ad19be6be', '2005e9b5-9c11-4b82-aac0-de89ced669b2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:30 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:51:30 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:30 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 1073741824" returned: 0 in 1.196s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:30 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 Jul 07 17:51:30 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:31 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.792s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:51:31 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Deleted volume successfully. Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b71bb80-d4a6-4865-ad27-2ccb59c1b93a tempest-TaggedAttachmentsTest-1059768874 None] Lock "cinder-272ea03d-5e3e-4e8d-8243-6e37e2025e65-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:51:31 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325" returned: 0 in 0.803s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c81ea6d-cda6-4c57-a854-c3486204d152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d894815-8d54-45c5-b67f-d87c4af01325', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baefa486-40b6-4e98-9918-069686db0733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:31 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Volume volume-4d894815-8d54-45c5-b67f-d87c4af01325 (4d894815-8d54-45c5-b67f-d87c4af01325): created successfully Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baefa486-40b6-4e98-9918-069686db0733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Flow 'volume_create_manager' (48d4cec2-57a9-4914-811a-c0889bf1025a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:51:31 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2df8ab7b-f967-4418-bbba-b14e78d8ffd0 tempest-AttachVolumeNegativeTest-12418647 None] Created volume successfully. Jul 07 17:51:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-a11d3d54-955f-4a93-a81a-f3370c508b4f req-731c76e2-0f56-41ab-bdaa-28911f6ec351 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-a11d3d54-955f-4a93-a81a-f3370c508b4f req-731c76e2-0f56-41ab-bdaa-28911f6ec351 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:35 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ffd26d-73b6-43d5-917e-53280c296e8e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:51:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-a11d3d54-955f-4a93-a81a-f3370c508b4f req-731c76e2-0f56-41ab-bdaa-28911f6ec351 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:35 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 Jul 07 17:51:35 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:36 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-a11d3d54-955f-4a93-a81a-f3370c508b4f req-731c76e2-0f56-41ab-bdaa-28911f6ec351 tempest-AttachVolumeNegativeTest-12418647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325" returned: 0 in 0.931s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-a11d3d54-955f-4a93-a81a-f3370c508b4f req-731c76e2-0f56-41ab-bdaa-28911f6ec351 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-a11d3d54-955f-4a93-a81a-f3370c508b4f req-731c76e2-0f56-41ab-bdaa-28911f6ec351 tempest-AttachVolumeNegativeTest-12418647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-4d894815-8d54-45c5-b67f-d87c4af01325', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d115e7c-2beb-487e-8ff6-5358ac27e101', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:51:36 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-a11d3d54-955f-4a93-a81a-f3370c508b4f req-731c76e2-0f56-41ab-bdaa-28911f6ec351 tempest-AttachVolumeNegativeTest-12418647 None] attachment_update completed successfully. Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Flow 'volume_create_manager' (b909b5a3-85b4-47c2-aba1-c52c1e622275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5627937f-3207-4b99-a2c8-05779c21f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5627937f-3207-4b99-a2c8-05779c21f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1593127700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67e7c03-9591-4620-98a9-a63bb7477da9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='752d4fce3c6b4e0bbc953da8f308da1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:51:44Z,use_quota=True,user_id='46baf7ea94e6448e9edacf406ab358c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce8b2f7-ad16-4285-abef-fb1af09f1eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce8b2f7-ad16-4285-abef-fb1af09f1eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6928b7ca-1df2-4666-89ad-8af4959a9cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6928b7ca-1df2-4666-89ad-8af4959a9cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b67e7c03-9591-4620-98a9-a63bb7477da9', 'volume_name': 'volume-b67e7c03-9591-4620-98a9-a63bb7477da9', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8493d675-3738-4f7d-97ec-d5ad469873dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8493d675-3738-4f7d-97ec-d5ad469873dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e726a8e-8249-4110-b998-124f886769f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:44 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Volume b67e7c03-9591-4620-98a9-a63bb7477da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b67e7c03-9591-4620-98a9-a63bb7477da9', 'volume_size': 1} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1593127700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b67e7c03-9591-4620-98a9-a63bb7477da9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='752d4fce3c6b4e0bbc953da8f308da1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:51:44Z,use_quota=True,user_id='46baf7ea94e6448e9edacf406ab358c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Creating volume b67e7c03-9591-4620-98a9-a63bb7477da9 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:51:44 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:44 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 1073741824 Jul 07 17:51:44 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-cde22653-cd05-4a14-8f9e-54a8926de1b8 req-8cede03b-45de-451a-8603-73291069b63d tempest-AttachVolumeNegativeTest-12418647 None] Terminate volume connection completed successfully. Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-cde22653-cd05-4a14-8f9e-54a8926de1b8 req-8cede03b-45de-451a-8603-73291069b63d tempest-AttachVolumeNegativeTest-12418647 None] Deleting attachment 2d115e7c-2beb-487e-8ff6-5358ac27e101. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:51:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-b3cc34e4-87aa-42ae-aa07-d6f16a29eef8 req-e643cacf-a52e-4dfc-a017-a6900ef62e26 tempest-ServerActionsTestOtherA-1914570287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:45 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 1073741824" returned: 0 in 0.990s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:45 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 Jul 07 17:51:45 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:45 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9" returned: 0 in 0.710s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-b3cc34e4-87aa-42ae-aa07-d6f16a29eef8 req-e643cacf-a52e-4dfc-a017-a6900ef62e26 tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.075s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e726a8e-8249-4110-b998-124f886769f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b67e7c03-9591-4620-98a9-a63bb7477da9', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96722803-af1a-4ce2-8d62-f9ec3734aede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b4c6fd-f250-410a-86f7-2b7bd0dcb834]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-b3cc34e4-87aa-42ae-aa07-d6f16a29eef8 req-e643cacf-a52e-4dfc-a017-a6900ef62e26 tempest-ServerActionsTestOtherA-1914570287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:45 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Volume volume-b67e7c03-9591-4620-98a9-a63bb7477da9 (b67e7c03-9591-4620-98a9-a63bb7477da9): created successfully Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96722803-af1a-4ce2-8d62-f9ec3734aede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Flow 'volume_create_manager' (b909b5a3-85b4-47c2-aba1-c52c1e622275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:51:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b893a746-e6d1-434b-ac83-421e7eaf80ae tempest-VolumesTestJSON-861727027 None] Created volume successfully. Jul 07 17:51:46 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 Jul 07 17:51:46 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:51:46 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Flow 'volume_create_manager' (4af11bfe-d337-4e88-8933-2a3b7a6287d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28cf174-b81f-4e55-a333-3dea0a1a3b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-b3cc34e4-87aa-42ae-aa07-d6f16a29eef8 req-e643cacf-a52e-4dfc-a017-a6900ef62e26 tempest-ServerActionsTestOtherA-1914570287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642" returned: 0 in 1.035s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-b3cc34e4-87aa-42ae-aa07-d6f16a29eef8 req-e643cacf-a52e-4dfc-a017-a6900ef62e26 tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.067s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28cf174-b81f-4e55-a333-3dea0a1a3b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1446796874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a77da0-e244-40f1-a4b3-493d773aa93c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='752d4fce3c6b4e0bbc953da8f308da1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:51:47Z,use_quota=True,user_id='46baf7ea94e6448e9edacf406ab358c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2479def-9859-4e4b-9580-6ea5eb964239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2479def-9859-4e4b-9580-6ea5eb964239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1ef59b-4a7e-4770-b400-93670ed2e658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1ef59b-4a7e-4770-b400-93670ed2e658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a77da0-e244-40f1-a4b3-493d773aa93c', 'volume_name': 'volume-b2a77da0-e244-40f1-a4b3-493d773aa93c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ac93f7-1d82-4690-8b00-c00feee5b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ac93f7-1d82-4690-8b00-c00feee5b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77571856-e3b4-42cb-9a99-67fe008e2f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:46 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Volume b2a77da0-e244-40f1-a4b3-493d773aa93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a77da0-e244-40f1-a4b3-493d773aa93c', 'volume_size': 1} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1446796874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a77da0-e244-40f1-a4b3-493d773aa93c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='752d4fce3c6b4e0bbc953da8f308da1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:51:47Z,use_quota=True,user_id='46baf7ea94e6448e9edacf406ab358c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Creating volume b2a77da0-e244-40f1-a4b3-493d773aa93c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:51:46 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:51:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:47 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c 1073741824 Jul 07 17:51:47 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:47 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-b3cc34e4-87aa-42ae-aa07-d6f16a29eef8 req-e643cacf-a52e-4dfc-a017-a6900ef62e26 tempest-ServerActionsTestOtherA-1914570287 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-25bf3ceb-00a2-41ab-a309-c3762292b642', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83940cba-28d5-4b6d-9999-f831b9bcb1e4', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:51:47 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-b3cc34e4-87aa-42ae-aa07-d6f16a29eef8 req-e643cacf-a52e-4dfc-a017-a6900ef62e26 tempest-ServerActionsTestOtherA-1914570287 None] attachment_update completed successfully. Jul 07 17:51:48 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c 1073741824" returned: 0 in 1.058s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:48 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c Jul 07 17:51:48 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:49 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c" returned: 0 in 0.955s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:51:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77571856-e3b4-42cb-9a99-67fe008e2f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a77da0-e244-40f1-a4b3-493d773aa93c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5083a6eb-0a4b-43a7-affb-6da8f8e72f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:49 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Volume volume-b2a77da0-e244-40f1-a4b3-493d773aa93c (b2a77da0-e244-40f1-a4b3-493d773aa93c): created successfully Jul 07 17:51:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5083a6eb-0a4b-43a7-affb-6da8f8e72f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Flow 'volume_create_manager' (4af11bfe-d337-4e88-8933-2a3b7a6287d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:51:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4b47248d-46c1-4ff1-ac53-27a3579b6eb7 tempest-VolumesTestJSON-861727027 None] Created volume successfully. Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Flow 'volume_create_manager' (419a8946-0936-4930-9289-b171dc840bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8ff6b3-4096-4adb-802a-738e313d5f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b8ff6b3-4096-4adb-802a-738e313d5f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-341017290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e35f6-10a7-43d4-8f83-d099d6e4cb47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='752d4fce3c6b4e0bbc953da8f308da1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:51:51Z,use_quota=True,user_id='46baf7ea94e6448e9edacf406ab358c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cce72a4-83ce-4900-b96d-7a6cc9876864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cce72a4-83ce-4900-b96d-7a6cc9876864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c0d152-8d87-4cd8-93c9-897a27494cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62c0d152-8d87-4cd8-93c9-897a27494cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4e35f6-10a7-43d4-8f83-d099d6e4cb47', 'volume_name': 'volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8742bd-4698-4c04-ae3a-e574b42d8b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8742bd-4698-4c04-ae3a-e574b42d8b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f89d0b0-0981-46a6-b695-c129e58d91de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:50 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Volume ee4e35f6-10a7-43d4-8f83-d099d6e4cb47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47', 'volume_size': 1} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-341017290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4e35f6-10a7-43d4-8f83-d099d6e4cb47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='752d4fce3c6b4e0bbc953da8f308da1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:51:51Z,use_quota=True,user_id='46baf7ea94e6448e9edacf406ab358c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Creating volume ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:51:50 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:51:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:50 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 1073741824 Jul 07 17:51:50 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:51 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 1073741824" returned: 0 in 0.865s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:51 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 Jul 07 17:51:51 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:52 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47" returned: 0 in 0.790s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:51:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f89d0b0-0981-46a6-b695-c129e58d91de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c45a35-bafc-44c6-9dad-30876543d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:51:52 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Volume volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 (ee4e35f6-10a7-43d4-8f83-d099d6e4cb47): created successfully Jul 07 17:51:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c45a35-bafc-44c6-9dad-30876543d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:51:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Flow 'volume_create_manager' (419a8946-0936-4930-9289-b171dc840bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:51:52 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2fca18e4-2a8a-43e6-a8ff-9cea7583e929 tempest-VolumesTestJSON-861727027 None] Created volume successfully. Jul 07 17:51:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Acquiring lock "cinder-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:51:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Lock "cinder-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:51:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Acquiring lock "cinder-quobyte-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:51:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Lock "cinder-quobyte-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:51:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a58c6a-f6b0-4560-8eb6-bcf91683c8f5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:51:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:54 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 Jul 07 17:51:54 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:55 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47" returned: 0 in 0.874s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:55 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47 Jul 07 17:51:55 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-51b996cf-69eb-4677-ae5d-d94d037f169c tempest-ServerActionsTestOtherA-1914570287 None] Terminate volume connection completed successfully. Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-51b996cf-69eb-4677-ae5d-d94d037f169c tempest-ServerActionsTestOtherA-1914570287 None] Deleting attachment 83940cba-28d5-4b6d-9999-f831b9bcb1e4. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:51:56 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47" returned: 0 in 0.881s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Lock "cinder-quobyte-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47" released by "delete_volume" :: held 1.831s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Created reservations ['a94100b5-d7c3-487b-a1e2-93bb2401fb24', '5b81c87f-08ab-42e3-880d-185857938f5f', '07fa4d85-fc2a-4cdd-9e1d-af078240dfd8', '08f60b3d-8ed2-4a84-9118-01569de23175'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:56 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:51:56 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Acquiring lock "cinder-b2a77da0-e244-40f1-a4b3-493d773aa93c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Lock "cinder-b2a77da0-e244-40f1-a4b3-493d773aa93c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Acquiring lock "cinder-quobyte-b2a77da0-e244-40f1-a4b3-493d773aa93c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Lock "cinder-quobyte-b2a77da0-e244-40f1-a4b3-493d773aa93c" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4ad586-87ff-4102-8e77-2c917ad852e5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:51:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:57 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c Jul 07 17:51:57 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:57 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.363s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:57 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:51:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Deleted volume successfully. Jul 07 17:51:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b6cce80e-6977-440f-969f-c00a729f8f46 tempest-VolumesTestJSON-861727027 None] Lock "cinder-ee4e35f6-10a7-43d4-8f83-d099d6e4cb47-delete_volume" released by "delete_volume" :: held 3.562s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:51:58 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c" returned: 0 in 1.368s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:58 devstack sudo[92167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c Jul 07 17:51:58 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-84fca84c-95be-4007-82bb-188651d9701d tempest-ServerActionsTestOtherA-1914570287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-84fca84c-95be-4007-82bb-188651d9701d tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dd879f-d498-461c-bad7-d16d371bb1d3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-84fca84c-95be-4007-82bb-188651d9701d tempest-ServerActionsTestOtherA-1914570287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:59 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 Jul 07 17:51:59 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:51:59 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2a77da0-e244-40f1-a4b3-493d773aa93c" returned: 0 in 1.159s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Lock "cinder-quobyte-b2a77da0-e244-40f1-a4b3-493d773aa93c" released by "delete_volume" :: held 2.611s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Created reservations ['2537d8d7-5ba8-481f-b52b-e100f94cbd13', '028b70b3-5d49-4ddf-bf99-29ac946a3e5c', '3d852f99-e62a-4c89-b3a5-da8f9de696ef', 'e968d7cd-500b-4af3-a5d8-54d6c267ccd7'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:51:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:51:59 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:51:59 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Acquiring lock "cinder-b67e7c03-9591-4620-98a9-a63bb7477da9-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Lock "cinder-b67e7c03-9591-4620-98a9-a63bb7477da9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Acquiring lock "cinder-quobyte-b67e7c03-9591-4620-98a9-a63bb7477da9" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Lock "cinder-quobyte-b67e7c03-9591-4620-98a9-a63bb7477da9" acquired by "delete_volume" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec7bb3d-24e2-4470-b37d-e201d356eb16]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:00 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-84fca84c-95be-4007-82bb-188651d9701d tempest-ServerActionsTestOtherA-1914570287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642" returned: 0 in 1.496s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-84fca84c-95be-4007-82bb-188651d9701d tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.516s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:00 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.071s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:52:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Deleted volume successfully. Jul 07 17:52:00 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 Jul 07 17:52:00 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-84fca84c-95be-4007-82bb-188651d9701d tempest-ServerActionsTestOtherA-1914570287 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-25bf3ceb-00a2-41ab-a309-c3762292b642', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17b41dc7-e73b-4db4-a71d-e9e4ca546048', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:52:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-df10321e-7609-4f23-8c9f-0947b115cf6f tempest-VolumesTestJSON-861727027 None] Lock "cinder-b2a77da0-e244-40f1-a4b3-493d773aa93c-delete_volume" released by "delete_volume" :: held 4.117s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:52:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-d96a2f4c-b474-4137-a5fd-c9fc9ddf6b1a req-84fca84c-95be-4007-82bb-188651d9701d tempest-ServerActionsTestOtherA-1914570287 None] attachment_update completed successfully. Jul 07 17:52:01 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9" returned: 0 in 1.107s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:01 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9 Jul 07 17:52:01 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:02 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b67e7c03-9591-4620-98a9-a63bb7477da9" returned: 0 in 1.103s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Lock "cinder-quobyte-b67e7c03-9591-4620-98a9-a63bb7477da9" released by "delete_volume" :: held 2.294s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:52:02 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Created reservations ['4feb74d1-ff4e-404d-8dd4-19bc4f89cab6', '9bff2da3-b261-4fd3-9bac-6201ac479b91', 'dc0e2111-561b-4120-b09e-dbfba46d681c', '685c7546-fe96-4330-910a-8bcbabbbab04'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:52:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:52:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:52:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:52:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:52:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:03 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:52:03 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:04 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.099s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:04 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:52:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Deleted volume successfully. Jul 07 17:52:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-806e20fc-b669-480d-9e90-d9a505a0bfe5 tempest-VolumesTestJSON-861727027 None] Lock "cinder-b67e7c03-9591-4620-98a9-a63bb7477da9-delete_volume" released by "delete_volume" :: held 3.918s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:52:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f676ab09-cd8b-4c49-9a48-ed8b852ed98e tempest-BackendsCapabilitiesAdminTestsJSON-1448187555 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.690715789795, 'free_capacity_gb': 1775.690715789795, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87228) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 07 17:52:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b76ab265-9d38-461f-ae25-f08b8c0b451d tempest-BackendsCapabilitiesAdminTestsJSON-1448187555 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.690715789795, 'free_capacity_gb': 1775.690715789795, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87228) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 07 17:52:13 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=47,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:52:14 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=52,cinder:SELECT=47,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:52:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:52:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:52:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:52:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:52:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:52:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:23 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:52:23 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:24 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Flow 'volume_create_manager' (da921780-7ec5-44ef-9e98-69102b271cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e693f1-c0e6-4f47-bff7-6b8f5fe67216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:25 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e693f1-c0e6-4f47-bff7-6b8f5fe67216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1483809971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813503e6-3c7c-426f-815b-ef8e5e035aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a648d0443b9478d97baf208d495b4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:52:25Z,use_quota=True,user_id='ed713c4d6b8844bfb611695519a5b7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc36aca-f8a5-4f5e-bbbf-ab6054478812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc36aca-f8a5-4f5e-bbbf-ab6054478812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731e36eb-c7be-461f-b3f1-b2a8012bc90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731e36eb-c7be-461f-b3f1-b2a8012bc90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813503e6-3c7c-426f-815b-ef8e5e035aa9', 'volume_name': 'volume-813503e6-3c7c-426f-815b-ef8e5e035aa9', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c882d421-aa10-4e73-a542-a0d4e0b6ed57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c882d421-aa10-4e73-a542-a0d4e0b6ed57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f81bea-1f33-4733-9aa5-06bf368ba098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:25 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Volume 813503e6-3c7c-426f-815b-ef8e5e035aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813503e6-3c7c-426f-815b-ef8e5e035aa9', 'volume_size': 1} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1483809971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813503e6-3c7c-426f-815b-ef8e5e035aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a648d0443b9478d97baf208d495b4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:52:25Z,use_quota=True,user_id='ed713c4d6b8844bfb611695519a5b7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Creating volume 813503e6-3c7c-426f-815b-ef8e5e035aa9 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:52:25 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.361s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 8 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:52:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:52:25 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 1073741824 Jul 07 17:52:25 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:26 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 1073741824" returned: 0 in 1.088s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:26 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 Jul 07 17:52:26 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:26 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9" returned: 0 in 0.736s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:52:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f81bea-1f33-4733-9aa5-06bf368ba098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813503e6-3c7c-426f-815b-ef8e5e035aa9', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61fe8612-9da3-4a18-bccc-db9ef3100149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:27 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Volume volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 (813503e6-3c7c-426f-815b-ef8e5e035aa9): created successfully Jul 07 17:52:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61fe8612-9da3-4a18-bccc-db9ef3100149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Flow 'volume_create_manager' (da921780-7ec5-44ef-9e98-69102b271cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:52:27 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ebd9c881-c8d1-43da-b013-5832eab63623 tempest-AttachVolumeShelveTestJSON-1633741694 None] Created volume successfully. Jul 07 17:52:36 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-ec85ef41-d771-4425-8a54-d84bda31d83e req-bc2b1172-bf7b-4765-a790-59b2c21e7860 tempest-ServerActionsTestOtherA-1914570287 None] Terminate volume connection completed successfully. Jul 07 17:52:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-ec85ef41-d771-4425-8a54-d84bda31d83e req-bc2b1172-bf7b-4765-a790-59b2c21e7860 tempest-ServerActionsTestOtherA-1914570287 None] Deleting attachment 17b41dc7-e73b-4db4-a71d-e9e4ca546048. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Flow 'volume_create_manager' (78b17a93-81b9-4fe7-856d-f044ee4ae7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bdc3b7-8e36-4c21-95b3-806ca6ee0c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bdc3b7-8e36-4c21-95b3-806ca6ee0c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-101235065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2198b643d6134782a5f204efde338ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:52:43Z,use_quota=True,user_id='1a9c0b7fc6764c6d81742ae4a08c8e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83562305-b84e-4e81-83a9-a32ffce4c33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83562305-b84e-4e81-83a9-a32ffce4c33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79e2351-7279-40d6-aac6-9a2dfbfb380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79e2351-7279-40d6-aac6-9a2dfbfb380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0', 'volume_name': 'volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de046a1-ab0d-44b3-8519-00f97967c2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de046a1-ab0d-44b3-8519-00f97967c2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5698e3e3-c78f-4074-8e3e-73b41fb4bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:43 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Volume f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0', 'volume_size': 1} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-101235065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2198b643d6134782a5f204efde338ae1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:52:43Z,use_quota=True,user_id='1a9c0b7fc6764c6d81742ae4a08c8e73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Creating volume f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:52:43 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:52:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:43 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 1073741824 Jul 07 17:52:43 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-b4c8798d-ec9a-4e40-85bd-63faa1eef198 req-1bf0376b-c50b-487c-9c71-5d6c8761c7ff tempest-AttachVolumeShelveTestJSON-1633741694 None] No connector for attachment 09d69027-aad5-4d84-9a5f-25ea1181f419; skipping storage backend terminate_connection call. {{(pid=87228) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}} Jul 07 17:52:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-b4c8798d-ec9a-4e40-85bd-63faa1eef198 req-1bf0376b-c50b-487c-9c71-5d6c8761c7ff tempest-AttachVolumeShelveTestJSON-1633741694 None] Deleting attachment 09d69027-aad5-4d84-9a5f-25ea1181f419. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:52:44 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 1073741824" returned: 0 in 1.220s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:44 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 Jul 07 17:52:44 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:45 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0" returned: 0 in 0.830s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:52:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5698e3e3-c78f-4074-8e3e-73b41fb4bd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ba378d-574b-4a9d-8422-3ecfb02c7f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:52:45 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Volume volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 (f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0): created successfully Jul 07 17:52:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ba378d-574b-4a9d-8422-3ecfb02c7f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:52:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Flow 'volume_create_manager' (78b17a93-81b9-4fe7-856d-f044ee4ae7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:52:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c9c5bff9-e1ae-4e4c-8cfe-10345d03b150 tempest-AttachVolumeNegativeTest-12418647 None] Created volume successfully. Jul 07 17:52:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Acquiring lock "cinder-25bf3ceb-00a2-41ab-a309-c3762292b642-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:52:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Lock "cinder-25bf3ceb-00a2-41ab-a309-c3762292b642-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:52:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Acquiring lock "cinder-quobyte-25bf3ceb-00a2-41ab-a309-c3762292b642" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:52:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Lock "cinder-quobyte-25bf3ceb-00a2-41ab-a309-c3762292b642" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:52:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa8221a-bdf3-4263-8150-55ff228618d7]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:52:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:48 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 Jul 07 17:52:48 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:49 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642" returned: 0 in 0.850s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:49 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642 Jul 07 17:52:49 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-5dd3b596-06ba-453b-973c-764a024a66da req-d5a1c008-4ad1-4c47-a335-3feaf6f1fdcc tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:52:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-5dd3b596-06ba-453b-973c-764a024a66da req-d5a1c008-4ad1-4c47-a335-3feaf6f1fdcc tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:52:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d1f3c-69db-4cde-9f17-316ce502c503]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:52:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-5dd3b596-06ba-453b-973c-764a024a66da req-d5a1c008-4ad1-4c47-a335-3feaf6f1fdcc tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:50 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 Jul 07 17:52:50 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:50 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-25bf3ceb-00a2-41ab-a309-c3762292b642" returned: 0 in 0.801s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Lock "cinder-quobyte-25bf3ceb-00a2-41ab-a309-c3762292b642" released by "delete_volume" :: held 1.710s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Created reservations ['0238f8aa-14fc-46ab-ba9c-b70e078f51ae', 'f2dd6474-59c6-44ba-9ebf-fa29cbd8e195', '87819067-1968-47e4-837d-9829750059db', '6bd0d5e3-3883-454c-932d-e0a15f79f84b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:50 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:52:50 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:50 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-5dd3b596-06ba-453b-973c-764a024a66da req-d5a1c008-4ad1-4c47-a335-3feaf6f1fdcc tempest-AttachVolumeNegativeTest-12418647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0" returned: 0 in 0.958s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-5dd3b596-06ba-453b-973c-764a024a66da req-d5a1c008-4ad1-4c47-a335-3feaf6f1fdcc tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.998s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:52:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-5dd3b596-06ba-453b-973c-764a024a66da req-d5a1c008-4ad1-4c47-a335-3feaf6f1fdcc tempest-AttachVolumeNegativeTest-12418647 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8301053-1468-43e6-8d75-d8236a9ad91d', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:52:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-5dd3b596-06ba-453b-973c-764a024a66da req-d5a1c008-4ad1-4c47-a335-3feaf6f1fdcc tempest-AttachVolumeNegativeTest-12418647 None] attachment_update completed successfully. Jul 07 17:52:51 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.053s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:51 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:52:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Deleted volume successfully. Jul 07 17:52:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-77b85ae2-0a2d-4ffd-8d6d-d7f57ffc3f48 tempest-ServerActionsTestOtherA-1914570287 None] Lock "cinder-25bf3ceb-00a2-41ab-a309-c3762292b642-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:52:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-4be2fab6-4dea-4d7a-b836-4fab959fa9d0 req-02ab3066-0127-4a4d-8d29-b1e663a46c07 tempest-AttachVolumeNegativeTest-12418647 None] Terminate volume connection completed successfully. Jul 07 17:52:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-4be2fab6-4dea-4d7a-b836-4fab959fa9d0 req-02ab3066-0127-4a4d-8d29-b1e663a46c07 tempest-AttachVolumeNegativeTest-12418647 None] Deleting attachment c8301053-1468-43e6-8d75-d8236a9ad91d. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:53:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=16,cinder:SELECT=18,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:53:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=17,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:53:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "cinder-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "cinder-quobyte-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-quobyte-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a428a6-2855-403e-b2c7-5df12aede727]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:53:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:16 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 Jul 07 17:53:16 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:17 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0" returned: 0 in 0.990s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:17 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0 Jul 07 17:53:17 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:18 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0" returned: 0 in 0.942s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-quobyte-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0" released by "delete_volume" :: held 1.990s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Created reservations ['029f70e2-eae5-468b-bfb8-a8b05b4e86e8', '284eda90-7b84-4476-9393-05179eb7e639', '2f93a6f3-cfae-40f2-9ea8-83eef0a30a3d', 'b83381cf-68a2-4b5b-b816-9f259be361e3'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:18 devstack sudo[93661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:53:18 devstack sudo[93661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:19 devstack sudo[93661]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.087s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:19 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:53:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Deleted volume successfully. Jul 07 17:53:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3951386f-db9a-429a-9c5b-d2f34273b777 tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-f11d4030-4fc2-4ee1-bd8d-8a5d9273daf0-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "cinder-4d894815-8d54-45c5-b67f-d87c4af01325-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-4d894815-8d54-45c5-b67f-d87c4af01325-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "cinder-quobyte-4d894815-8d54-45c5-b67f-d87c4af01325" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-quobyte-4d894815-8d54-45c5-b67f-d87c4af01325" acquired by "delete_volume" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e5898d-8013-46e8-8c5a-faa1774516d3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:53:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:20 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 Jul 07 17:53:20 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:21 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325" returned: 0 in 1.609s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:21 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325 Jul 07 17:53:21 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:22 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4d894815-8d54-45c5-b67f-d87c4af01325" returned: 0 in 1.202s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-quobyte-4d894815-8d54-45c5-b67f-d87c4af01325" released by "delete_volume" :: held 2.876s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Created reservations ['2ecd52e4-8a0d-40d3-a343-25e1d0499f7a', '4635c727-27d4-4000-bed1-113aaa569763', '84040134-54c2-496b-ba74-bb479cc5abab', 'c8058240-310a-4658-babe-670cae4b0608'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:23 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:53:23 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "cinder-f02f322b-ff4b-4b4c-a465-48de15c6ae40-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:23 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:53:23 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-f02f322b-ff4b-4b4c-a465-48de15c6ae40-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "cinder-quobyte-f02f322b-ff4b-4b4c-a465-48de15c6ae40" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-quobyte-f02f322b-ff4b-4b4c-a465-48de15c6ae40" acquired by "delete_volume" :: waited 0.035s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7bffe9-e54d-4125-99df-a1dbf423bb76]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:53:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:24 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 Jul 07 17:53:24 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:24 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.375s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:53:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Deleted volume successfully. Jul 07 17:53:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4383c9d-728e-4087-b67a-794a04a6dbdc tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-4d894815-8d54-45c5-b67f-d87c4af01325-delete_volume" released by "delete_volume" :: held 4.671s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:25 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.531s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:25 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:53:25 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:53:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 8 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:53:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:53:25 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40" returned: 0 in 1.701s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:25 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40 Jul 07 17:53:25 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:26 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f02f322b-ff4b-4b4c-a465-48de15c6ae40" returned: 0 in 0.976s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-quobyte-f02f322b-ff4b-4b4c-a465-48de15c6ae40" released by "delete_volume" :: held 2.765s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:26 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Created reservations ['6f9737a9-f122-49d3-99f2-18571161cfe7', 'd3913c1f-2e28-46ea-825c-df085aef99b5', 'd39c2692-255a-4c5f-8bb5-8577d903d507', '81af492e-977f-4f00-b22e-4545ea92c4f7'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:53:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:27 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:53:27 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:28 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.989s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:28 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:53:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Deleted volume successfully. Jul 07 17:53:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c361f7ce-e23c-4f23-b07c-04d974ebce0d tempest-AttachVolumeNegativeTest-12418647 None] Lock "cinder-f02f322b-ff4b-4b4c-a465-48de15c6ae40-delete_volume" released by "delete_volume" :: held 4.163s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=23,cinder:SELECT=15,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:53:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f1df641a-7585-4c94-995a-7dee50305a1b tempest-GroupSnapshotsTest-1654924055 None] Group tempest-GroupSnapshotsTest-Group-294606415: creating Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (5d663c7e-6aa6-4a3f-ba03-e8d23154c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f64cf53-f5e5-4b6e-be32-31d71d257cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f64cf53-f5e5-4b6e-be32-31d71d257cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-554756280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc04eae-b1bb-4536-aca9-5d2e17eee1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:53:38Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baab7ebb-acdf-4aa9-bb12-9a0845763309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baab7ebb-acdf-4aa9-bb12-9a0845763309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eabc5fd-2092-4f92-b065-3092633afb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eabc5fd-2092-4f92-b065-3092633afb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc04eae-b1bb-4536-aca9-5d2e17eee1e6', 'volume_name': 'volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92d7958-9f6c-4d68-9aaf-76ad3b129900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92d7958-9f6c-4d68-9aaf-76ad3b129900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d40c5c3-454e-471b-a7f5-72804f4c79ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:37 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Volume 3cc04eae-b1bb-4536-aca9-5d2e17eee1e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6', 'volume_size': 1} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-554756280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc04eae-b1bb-4536-aca9-5d2e17eee1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:53:38Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Creating volume 3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:53:37 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:53:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f1df641a-7585-4c94-995a-7dee50305a1b tempest-GroupSnapshotsTest-1654924055 None] Group tempest-GroupSnapshotsTest-Group-294606415: created successfully Jul 07 17:53:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f1df641a-7585-4c94-995a-7dee50305a1b tempest-GroupSnapshotsTest-1654924055 None] Create group completed successfully. Jul 07 17:53:37 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 1073741824 Jul 07 17:53:37 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:39 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 1073741824" returned: 0 in 1.862s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:39 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 Jul 07 17:53:39 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Flow 'volume_create_manager' (9eadd460-323e-45d8-9502-1c21561748e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831358b5-0ae5-4603-bf75-f243737621ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831358b5-0ae5-4603-bf75-f243737621ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-460749828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa8f66ba-9f5b-4339-b06d-4db578c93ebe,host='devstack@QuobyteHD#QuobyteHD',id=9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3c6260ea4b4502b64b0078ad83786d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:53:40Z,use_quota=True,user_id='3f0e29b741ed402d9cd8c5eaa30f7cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db358cc7-8bee-4e97-886f-75000008a73a),volume_type_id=db358cc7-8bee-4e97-886f-75000008a73a)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255ce849-dbd2-4eb1-9a5b-cb50a69946c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255ce849-dbd2-4eb1-9a5b-cb50a69946c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ce07cb-80b2-49dd-9c5d-92250beb5cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ce07cb-80b2-49dd-9c5d-92250beb5cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8', 'volume_name': 'volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1edcc6f-3944-4a93-90f1-364dfc6208d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1edcc6f-3944-4a93-90f1-364dfc6208d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20884b8e-1d44-4c55-936e-c6ba8b341586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:40 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Volume 9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8', 'volume_size': 1} Jul 07 17:53:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:41 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" returned: 0 in 1.493s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] <== create_volume: return (3491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.493s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa8f66ba-9f5b-4339-b06d-4db578c93ebe,created_at=2026-07-07T15:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-460749828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa8f66ba-9f5b-4339-b06d-4db578c93ebe,host='devstack@QuobyteHD#QuobyteHD',id=9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3c6260ea4b4502b64b0078ad83786d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:53:40Z,use_quota=True,user_id='3f0e29b741ed402d9cd8c5eaa30f7cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db358cc7-8bee-4e97-886f-75000008a73a),volume_type_id=db358cc7-8bee-4e97-886f-75000008a73a)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Creating volume 9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:53:41 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:41 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 1073741824 Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d40c5c3-454e-471b-a7f5-72804f4c79ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:41 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742bea23-d5d0-4d92-b3cc-013b8841df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:41 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Volume volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 (3cc04eae-b1bb-4536-aca9-5d2e17eee1e6): created successfully Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742bea23-d5d0-4d92-b3cc-013b8841df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (5d663c7e-6aa6-4a3f-ba03-e8d23154c634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:53:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3a7b9fe3-bd84-4418-98c8-22a866c49c2b tempest-VolumesActionsTest-227891384 None] Created volume successfully. Jul 07 17:53:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-843bd162-7049-4452-af83-d02cb3123440 tempest-VolumesActionsTest-227891384 None] Acquiring lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" by "attach_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-843bd162-7049-4452-af83-d02cb3123440 tempest-VolumesActionsTest-227891384 None] Lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" acquired by "attach_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-843bd162-7049-4452-af83-d02cb3123440 tempest-VolumesActionsTest-227891384 None] Attaching volume 3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 to instance 3ad12327-9cbe-438b-a816-3517afc1d494 at mountpoint /dev/vdb on host None. Jul 07 17:53:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-843bd162-7049-4452-af83-d02cb3123440 tempest-VolumesActionsTest-227891384 None] Attach volume completed successfully. Jul 07 17:53:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-843bd162-7049-4452-af83-d02cb3123440 tempest-VolumesActionsTest-227891384 None] Lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" released by "attach_volume" :: held 0.131s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:42 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 1073741824" returned: 0 in 1.493s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:43 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 Jul 07 17:53:43 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:43 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" returned: 0 in 1.066s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] <== create_volume: return (2634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.638s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20884b8e-1d44-4c55-936e-c6ba8b341586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e795e0-eeec-44af-92f2-b1bf932ce1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:53:44 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Volume volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 (9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8): created successfully Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e795e0-eeec-44af-92f2-b1bf932ce1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Flow 'volume_create_manager' (9eadd460-323e-45d8-9502-1c21561748e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:53:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f9990503-896b-432b-bf56-e8bcf629b5e1 tempest-VolumesActionsTest-235115780 None] Terminate volume connection completed successfully. Jul 07 17:53:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4b70a2eb-7537-4461-89ab-fe424f9ffd7c tempest-GroupSnapshotsTest-1654924055 None] Created volume successfully. Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f9990503-896b-432b-bf56-e8bcf629b5e1 tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-detach_volume" by "detach_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f9990503-896b-432b-bf56-e8bcf629b5e1 tempest-VolumesActionsTest-235115780 None] Lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f9990503-896b-432b-bf56-e8bcf629b5e1 tempest-VolumesActionsTest-235115780 None] Detaching volume 3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 from instance 3ad12327-9cbe-438b-a816-3517afc1d494. Jul 07 17:53:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f9990503-896b-432b-bf56-e8bcf629b5e1 tempest-VolumesActionsTest-235115780 None] Detach volume completed successfully. Jul 07 17:53:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f9990503-896b-432b-bf56-e8bcf629b5e1 tempest-VolumesActionsTest-235115780 None] Lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-detach_volume" released by "detach_volume" :: held 0.168s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] GroupSnapshot b5d7c345-f128-4b12-8b70-f79d32f682eb: creating. Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Group snapshot b5d7c345-f128-4b12-8b70-f79d32f682eb: creating. {{(pid=87228) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Creating offline snapshot 59260163-ca7f-498e-8130-676dc9a5c2f6 of volume 9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb57eed-8341-4eca-9522-9bb742a199bc]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-14449b9f-0de9-4f80-8b15-4268f7100e98 tempest-VolumesActionsTest-227891384 None] Acquiring lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-detach_volume" by "detach_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-14449b9f-0de9-4f80-8b15-4268f7100e98 tempest-VolumesActionsTest-227891384 None] Lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-14449b9f-0de9-4f80-8b15-4268f7100e98 tempest-VolumesActionsTest-227891384 None] Volume detach called, but volume not attached. Jul 07 17:53:45 devstack sudo[93970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 Jul 07 17:53:45 devstack sudo[93970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-14449b9f-0de9-4f80-8b15-4268f7100e98 tempest-VolumesActionsTest-227891384 None] Lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Acquiring lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Acquiring lock "cinder-quobyte-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Lock "cinder-quobyte-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" acquired by "delete_volume" :: waited 0.048s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e9974e-7ffc-4fbf-bc1c-9abd320745ee]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:53:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:46 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 Jul 07 17:53:46 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:47 devstack sudo[93970]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" returned: 0 in 1.828s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:47 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 1G Jul 07 17:53:47 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:48 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" returned: 0 in 2.081s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:48 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6 Jul 07 17:53:48 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Acquiring lock "cinder-813503e6-3c7c-426f-815b-ef8e5e035aa9-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "cinder-813503e6-3c7c-426f-815b-ef8e5e035aa9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:49 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 1G" returned: 0 in 1.964s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Acquiring lock "cinder-quobyte-813503e6-3c7c-426f-815b-ef8e5e035aa9" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:49 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 Jul 07 17:53:49 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "cinder-quobyte-813503e6-3c7c-426f-815b-ef8e5e035aa9" acquired by "delete_volume" :: waited 0.050s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd70be-ad02-4809-8c8e-143690d7702f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:49 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 Jul 07 17:53:49 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:49 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" returned: 0 in 1.262s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Lock "cinder-quobyte-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6" released by "delete_volume" :: held 3.433s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Created reservations ['739e253e-c932-403f-9f82-bee4a17e5a98', '86502f6a-b199-4f97-8dd0-4ee39abd2610', 'ce45ce13-a5dc-48de-8446-4558be75eda4', 'd249bc16-1bc0-4201-96b2-7c8c40c4949d'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:50 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:53:50 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:50 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6" returned: 0 in 1.471s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:50 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:50 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 Jul 07 17:53:50 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:50 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9" returned: 0 in 1.461s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:50 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9 Jul 07 17:53:50 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:51 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.901s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:51 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:53:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Deleted volume successfully. Jul 07 17:53:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181dfcf7-796c-42a1-b512-673872e62488 tempest-VolumesActionsTest-227891384 None] Lock "cinder-3cc04eae-b1bb-4536-aca9-5d2e17eee1e6-delete_volume" released by "delete_volume" :: held 4.828s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:51 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6" returned: 0 in 0.846s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:51 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.info Jul 07 17:53:51 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:51 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-813503e6-3c7c-426f-815b-ef8e5e035aa9" returned: 0 in 1.258s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "cinder-quobyte-813503e6-3c7c-426f-815b-ef8e5e035aa9" released by "delete_volume" :: held 2.779s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:51 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Created reservations ['8be75a35-486d-40b5-a710-23c04a239d65', 'fdc3e154-78bf-42be-941c-744b0109d619', 'aa5cd0e3-3363-494a-84d7-cdc4baa73732', '86859463-d2a0-4251-9ab2-574979a03ac3'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:53:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:52 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:53:52 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:52 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.info" returned: 0 in 0.911s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:52 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:53:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:52 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.info Jul 07 17:53:52 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:53 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.960s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:53 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:53:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Deleted volume successfully. Jul 07 17:53:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4192493d-28a7-4e66-98a7-7e2ce24ed441 tempest-AttachVolumeShelveTestJSON-1633741694 None] Lock "cinder-813503e6-3c7c-426f-815b-ef8e5e035aa9-delete_volume" released by "delete_volume" :: held 4.111s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:53:53 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.info" returned: 0 in 1.242s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.493s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9aea214e-e20b-4c0f-90ae-71556491036f tempest-GroupSnapshotsTest-1654924055 None] group_snapshot b5d7c345-f128-4b12-8b70-f79d32f682eb: created successfully Jul 07 17:53:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-59260163-ca7f-498e-8130-676dc9a5c2f6-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-59260163-ca7f-498e-8130-676dc9a5c2f6-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" acquired by "_create_volume_from_snapshot" :: waited 0.065s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Creating volume bdf9e6f0-747d-4ef5-8a42-78c177239e6e from snapshot 59260163-ca7f-498e-8130-676dc9a5c2f6 {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] snapshot: 59260163-ca7f-498e-8130-676dc9a5c2f6, volume: bdf9e6f0-747d-4ef5-8a42-78c177239e6e, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[034489a8-97e2-477b-a58a-9543f7ce3bd1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:53:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:56 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 Jul 07 17:53:56 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:57 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6" returned: 0 in 1.479s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:53:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:53:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:53:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5cf475-b850-47a9-aae7-061558de242c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:53:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:57 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 Jul 07 17:53:57 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:58 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" returned: 0 in 1.015s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:58 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:53:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:58 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e Jul 07 17:53:58 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:05 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=44,cinder:INSERT=12,cinder:UPDATE=60,cinder:DELETE=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:54:06 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=35,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:54:06 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (05739759-f556-4821-bd30-745be8de3e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e79a80-ed22-4819-9343-48dd3ca0022c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e79a80-ed22-4819-9343-48dd3ca0022c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2057408887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38d38fd-8719-47d5-b86c-051c121a971f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:07Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59800c9-89ec-4e7a-bcbf-c73063354183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59800c9-89ec-4e7a-bcbf-c73063354183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb3e15b-c987-47ad-aa11-af1d7c0c2b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb3e15b-c987-47ad-aa11-af1d7c0c2b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38d38fd-8719-47d5-b86c-051c121a971f', 'volume_name': 'volume-d38d38fd-8719-47d5-b86c-051c121a971f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46385131-606c-416e-a976-8ee722308dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46385131-606c-416e-a976-8ee722308dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d260b36-b8ad-4ef2-86bd-3bea20f7b50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:07 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Volume d38d38fd-8719-47d5-b86c-051c121a971f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38d38fd-8719-47d5-b86c-051c121a971f', 'volume_size': 1} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:07 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" returned: 0 in 8.649s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5796204d-ea92-41f3-a35d-49c41baa3dd0]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:07 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 Jul 07 17:54:07 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:08 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" returned: 0 in 1.497s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:08 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8, size 1024.00 MB, duration 8.65 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:54:08 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Converted 1024.00 MB image at 118.39 MB/s Jul 07 17:54:08 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:54:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:08 devstack sudo[94214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e Jul 07 17:54:08 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:10 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" returned: 0 in 1.169s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" released by "_copy_volume_from_snapshot" :: held 13.961s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-59260163-ca7f-498e-8130-676dc9a5c2f6-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" released by "_create_volume_from_snapshot" :: held 14.057s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.123s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.865s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2057408887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38d38fd-8719-47d5-b86c-051c121a971f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:07Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Creating volume d38d38fd-8719-47d5-b86c-051c121a971f {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:10 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:10 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f 1073741824 Jul 07 17:54:10 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-eadd026a-dba0-46d9-8b43-89faf9321d2c tempest-GroupSnapshotsTest-1654924055 None] Create group from source-snapshot-b5d7c345-f128-4b12-8b70-f79d32f682eb completed successfully. Jul 07 17:54:11 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f 1073741824" returned: 0 in 1.062s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:11 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f Jul 07 17:54:11 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8e7709-b167-4f9d-9dbe-23fc3332dcb7]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:12 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e Jul 07 17:54:12 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:12 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f" returned: 0 in 1.048s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d260b36-b8ad-4ef2-86bd-3bea20f7b50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38d38fd-8719-47d5-b86c-051c121a971f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537433aa-5151-4cab-9494-cb5bed696750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:12 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Volume volume-d38d38fd-8719-47d5-b86c-051c121a971f (d38d38fd-8719-47d5-b86c-051c121a971f): created successfully Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537433aa-5151-4cab-9494-cb5bed696750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (05739759-f556-4821-bd30-745be8de3e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:12 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ac126f3a-8120-419c-8ef1-b64cb42ca879 tempest-VolumesActionsTest-227891384 None] Created volume successfully. Jul 07 17:54:12 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" returned: 0 in 0.884s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:12 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e Jul 07 17:54:12 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-d38d38fd-8719-47d5-b86c-051c121a971f-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Lock "cinder-d38d38fd-8719-47d5-b86c-051c121a971f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-quobyte-d38d38fd-8719-47d5-b86c-051c121a971f" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Lock "cinder-quobyte-d38d38fd-8719-47d5-b86c-051c121a971f" acquired by "delete_volume" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb837b5e-ef43-4464-ab44-2e29246d6da6]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:13 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f Jul 07 17:54:13 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:13 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" returned: 0 in 0.766s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-bdf9e6f0-747d-4ef5-8a42-78c177239e6e" released by "delete_volume" :: held 1.744s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['b060caf2-3e79-45b6-85af-37a9c5b53afe'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:13 devstack cinder-volume[87228]: WARNING cinder.quota [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1770417225 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1770417225, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:54:13 devstack cinder-volume[87228]: WARNING cinder.quota [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1770417225 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1770417225, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['4a81cfe8-7239-4311-98a3-8d70c9ab56a8', '56a6f747-e869-469f-9fff-97bf4b22f158', 'e7b2a42b-617e-443b-a66e-897c47e7bd9e', '32319778-8f4b-42c7-8788-6c1f8a1782d2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:14 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:14 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:14 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f" returned: 0 in 0.860s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:14 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f Jul 07 17:54:14 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] group_snapshot b5d7c345-f128-4b12-8b70-f79d32f682eb: deleting Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] group_snapshot b5d7c345-f128-4b12-8b70-f79d32f682eb: deleting {{(pid=87228) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-59260163-ca7f-498e-8130-676dc9a5c2f6" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-59260163-ca7f-498e-8130-676dc9a5c2f6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Deleting offline snapshot 59260163-ca7f-498e-8130-676dc9a5c2f6 of volume 9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] snapshot_file for this snap is: volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[19947713-248e-4720-ad9a-4bd7bf242711]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:14 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.912s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:14 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7793b967-71b2-41d5-9bed-fdbaa2a02308 tempest-GroupSnapshotsTest-1654924055 None] Delete group completed successfully. Jul 07 17:54:15 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 Jul 07 17:54:15 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:15 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d38d38fd-8719-47d5-b86c-051c121a971f" returned: 0 in 1.002s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Lock "cinder-quobyte-d38d38fd-8719-47d5-b86c-051c121a971f" released by "delete_volume" :: held 1.908s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Created reservations ['be14699a-bdba-4786-a3d6-6bc65b9d8c4c', '7e6b2463-9550-473b-a339-13d1dec208ec', '82c01902-ea1f-4dd6-a981-955ebdbe08de', '93cf0727-95d8-4432-8ae0-1da50b2eb017'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:15 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:15 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:15 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6" returned: 0 in 1.097s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[69847210-c7ee-4407-b414-e3ac30755ee8]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:16 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 Jul 07 17:54:16 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:16 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.894s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Deleted volume successfully. Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7963cbc6-e439-4f81-8e2d-6214c53ed68f tempest-VolumesActionsTest-235115780 None] Lock "cinder-d38d38fd-8719-47d5-b86c-051c121a971f-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (47e7fe2a-6c7b-41dc-8550-2add83cda633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0339b8de-7929-4082-8d5a-16276518b473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0339b8de-7929-4082-8d5a-16276518b473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1764355101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994f3fe4-e837-47d6-80f0-5aec60b6e163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:17Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d0660f-ea13-4dc5-8046-bb6dbd399de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d0660f-ea13-4dc5-8046-bb6dbd399de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e921053e-a53f-458e-9c79-256bb8a438b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e921053e-a53f-458e-9c79-256bb8a438b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994f3fe4-e837-47d6-80f0-5aec60b6e163', 'volume_name': 'volume-994f3fe4-e837-47d6-80f0-5aec60b6e163', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8bbd5c-90ac-46e5-bed8-9ac8ec7d99e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8bbd5c-90ac-46e5-bed8-9ac8ec7d99e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6fe2d5-48f5-4313-be95-6e8a86c9ad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:16 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Volume 994f3fe4-e837-47d6-80f0-5aec60b6e163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994f3fe4-e837-47d6-80f0-5aec60b6e163', 'volume_size': 1} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1764355101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994f3fe4-e837-47d6-80f0-5aec60b6e163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:17Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Creating volume 994f3fe4-e837-47d6-80f0-5aec60b6e163 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:16 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:16 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 1073741824 Jul 07 17:54:16 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:17 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" returned: 0 in 1.412s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:17 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 Jul 07 17:54:17 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Flow 'volume_create_manager' (158b9d15-d5a8-4baa-a5dd-fd1e0357460a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a24f1b-0c63-43b2-be92-2177c387e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a24f1b-0c63-43b2-be92-2177c387e506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1602635922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3c42d8-581b-403d-99f8-2706dc18b1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8caee9af7fc4a3bb502993be7cf8c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:18Z,use_quota=True,user_id='3c41bdb44ea34affbd4699a771e395fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e60222-00f0-42fd-95aa-2e090795f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e60222-00f0-42fd-95aa-2e090795f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9a0e1f-2cff-4d53-a64f-9238439a6e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9a0e1f-2cff-4d53-a64f-9238439a6e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3c42d8-581b-403d-99f8-2706dc18b1be', 'volume_name': 'volume-ee3c42d8-581b-403d-99f8-2706dc18b1be', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d57904-b8c4-45d2-9fde-2032d2e94f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d57904-b8c4-45d2-9fde-2032d2e94f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8faab478-b43c-44f7-8168-365b24e60188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:17 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Volume ee3c42d8-581b-403d-99f8-2706dc18b1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3c42d8-581b-403d-99f8-2706dc18b1be', 'volume_size': 1} Jul 07 17:54:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:18 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 1073741824" returned: 0 in 1.279s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:18 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 Jul 07 17:54:18 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:18 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6" returned: 0 in 1.222s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:18 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6 Jul 07 17:54:18 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:19 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163" returned: 0 in 0.874s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1602635922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3c42d8-581b-403d-99f8-2706dc18b1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8caee9af7fc4a3bb502993be7cf8c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:18Z,use_quota=True,user_id='3c41bdb44ea34affbd4699a771e395fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Creating volume ee3c42d8-581b-403d-99f8-2706dc18b1be {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:19 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6fe2d5-48f5-4313-be95-6e8a86c9ad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994f3fe4-e837-47d6-80f0-5aec60b6e163', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:19 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be 1073741824 Jul 07 17:54:19 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfff6d7-4619-4979-b605-3b7563eabe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Volume volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 (994f3fe4-e837-47d6-80f0-5aec60b6e163): created successfully Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfff6d7-4619-4979-b605-3b7563eabe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (47e7fe2a-6c7b-41dc-8550-2add83cda633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7bfe4a4d-4cb9-49ab-a69b-1080d0d7bc4d tempest-VolumesActionsTest-227891384 None] Created volume successfully. Jul 07 17:54:19 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8.59260163-ca7f-498e-8130-676dc9a5c2f6" returned: 0 in 0.853s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-59260163-ca7f-498e-8130-676dc9a5c2f6" released by "_delete_snapshot" :: held 4.746s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" released by "delete_snapshot" :: held 4.787s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:19 devstack cinder-volume[87228]: WARNING cinder.quota [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1770417225 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1770417225, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:54:19 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['81a677f7-e87a-49c6-acb4-0672c189a6b0', '8aed089c-2e3e-460f-a7bc-26551fd43636', '4885a0ce-72ea-4fa2-8eb2-c77879b32f9a', '775d2198-11c9-4658-bebc-49f0dcb67139'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8e4ea093-be66-488a-8761-20aa9835695e tempest-GroupSnapshotsTest-1654924055 None] group_snapshot b5d7c345-f128-4b12-8b70-f79d32f682eb: deleted successfully Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-994f3fe4-e837-47d6-80f0-5aec60b6e163-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Lock "cinder-994f3fe4-e837-47d6-80f0-5aec60b6e163-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-quobyte-994f3fe4-e837-47d6-80f0-5aec60b6e163" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Lock "cinder-quobyte-994f3fe4-e837-47d6-80f0-5aec60b6e163" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[13670b51-397b-4a61-bdde-edd63a2f106a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:20 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be 1073741824" returned: 0 in 1.349s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:20 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be Jul 07 17:54:20 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:20 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 Jul 07 17:54:20 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" acquired by "delete_volume" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[606efce3-63c3-4b1a-912d-7179fc2d9ef5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:21 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 Jul 07 17:54:21 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:21 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be" returned: 0 in 0.992s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] <== create_volume: return (2417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.423s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:21 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163" returned: 0 in 1.091s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:21 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163 Jul 07 17:54:21 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8faab478-b43c-44f7-8168-365b24e60188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3c42d8-581b-403d-99f8-2706dc18b1be', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb89caca-58a2-4429-b842-6971b4fdf6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:21 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Volume volume-ee3c42d8-581b-403d-99f8-2706dc18b1be (ee3c42d8-581b-403d-99f8-2706dc18b1be): created successfully Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb89caca-58a2-4429-b842-6971b4fdf6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Flow 'volume_create_manager' (158b9d15-d5a8-4baa-a5dd-fd1e0357460a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5d1e8fdd-3fec-41a8-91d3-df039ed95dc7 tempest-ServersNegativeTestJSON-333818181 None] Created volume successfully. Jul 07 17:54:21 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" returned: 0 in 1.031s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:22 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8 Jul 07 17:54:22 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:22 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-994f3fe4-e837-47d6-80f0-5aec60b6e163" returned: 0 in 0.805s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Lock "cinder-quobyte-994f3fe4-e837-47d6-80f0-5aec60b6e163" released by "delete_volume" :: held 1.973s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Created reservations ['2654cfef-0b00-4d3e-8572-11397afaa95d', '86e8399f-18bd-4580-9e9f-1d36a9c4a720', '634f9dc3-abf9-4675-9f41-c8405c41be94', '152d10a5-7484-42a2-8d5b-ee11aebc2a9a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:22 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:22 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:23 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" returned: 0 in 1.116s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-9b0fb4f1-1f56-4ae4-b32e-ffd81e7541b8" released by "delete_volume" :: held 2.269s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['7a1dc5b1-3d33-4d26-b6f2-4c8c86db0b64'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (3b82f039-4689-47a7-988b-877bbda70c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd4f505-5118-421b-9af6-80b74b6c2de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd4f505-5118-421b-9af6-80b74b6c2de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-162174892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f44462a-5ed6-4215-9c71-2ba29b76e7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:23Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9034b5ea-c151-4c98-ba76-3ceb3a226bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9034b5ea-c151-4c98-ba76-3ceb3a226bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01695ed1-18d6-4c0e-abce-3b8fbea2cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01695ed1-18d6-4c0e-abce-3b8fbea2cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f44462a-5ed6-4215-9c71-2ba29b76e7b7', 'volume_name': 'volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9190bebc-968f-4591-9166-10f592dc03b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9190bebc-968f-4591-9166-10f592dc03b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6bd6d3-1488-4eeb-a40f-1f91e763f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:23 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Volume 2f44462a-5ed6-4215-9c71-2ba29b76e7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7', 'volume_size': 1} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-162174892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f44462a-5ed6-4215-9c71-2ba29b76e7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:23Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Creating volume 2f44462a-5ed6-4215-9c71-2ba29b76e7b7 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:23 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:23 devstack cinder-volume[87228]: WARNING cinder.db.sqlalchemy.api [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1770417225'] Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['c2de5e4c-dac2-42b3-b368-02690e93701b', '7f9aee66-084e-4113-bdd8-4c47a4fa5b43', '2494bae8-db41-43a8-8c52-943b4e2a2bb2', '53ec95bd-1ec6-4e8c-b77e-bccc11037d5a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:23 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 1073741824 Jul 07 17:54:23 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:23 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.031s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Deleted volume successfully. Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d3736c89-0ada-48c7-8fe4-9420b4e63b95 tempest-VolumesActionsTest-235115780 None] Lock "cinder-994f3fe4-e837-47d6-80f0-5aec60b6e163-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:23 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:23 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:23 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:23 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Flow 'volume_create_manager' (0335a193-74c8-4852-8be5-e0cb5e3938ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77573045-4c71-456f-9e48-d0dba69fb32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77573045-4c71-456f-9e48-d0dba69fb32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-29927340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044d97f7-8e9e-4bfa-b6b4-eb388982ec19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8caee9af7fc4a3bb502993be7cf8c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:24Z,use_quota=True,user_id='3c41bdb44ea34affbd4699a771e395fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77613d8e-95c6-4135-a643-775d94c32005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77613d8e-95c6-4135-a643-775d94c32005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715149a9-95f7-40bd-9bdf-463bd160e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (715149a9-95f7-40bd-9bdf-463bd160e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044d97f7-8e9e-4bfa-b6b4-eb388982ec19', 'volume_name': 'volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9122e672-b604-436b-83bc-b4786e036578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9122e672-b604-436b-83bc-b4786e036578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1153d41f-488e-4383-b0c3-fb68fb4771ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:24 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Volume 044d97f7-8e9e-4bfa-b6b4-eb388982ec19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19', 'volume_size': 1} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:24 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.048s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-fc4343df-df0d-4218-8d4d-a8ae8f061ad0 tempest-GroupSnapshotsTest-1654924055 None] Delete group completed successfully. Jul 07 17:54:24 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.968s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 8 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:54:24 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 1073741824" returned: 0 in 1.378s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:24 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 Jul 07 17:54:24 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b25f5203-572d-4c1d-a093-1fa5a91479bb tempest-GroupSnapshotsTest-1654924055 None] Group tempest-GroupSnapshotsTest-Group-280078479: creating Jul 07 17:54:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b25f5203-572d-4c1d-a093-1fa5a91479bb tempest-GroupSnapshotsTest-1654924055 None] Group tempest-GroupSnapshotsTest-Group-280078479: created successfully Jul 07 17:54:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b25f5203-572d-4c1d-a093-1fa5a91479bb tempest-GroupSnapshotsTest-1654924055 None] Create group completed successfully. Jul 07 17:54:25 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7" returned: 0 in 0.823s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.263s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-29927340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044d97f7-8e9e-4bfa-b6b4-eb388982ec19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8caee9af7fc4a3bb502993be7cf8c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:24Z,use_quota=True,user_id='3c41bdb44ea34affbd4699a771e395fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Creating volume 044d97f7-8e9e-4bfa-b6b4-eb388982ec19 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:25 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6bd6d3-1488-4eeb-a40f-1f91e763f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3072f5-9af9-4f94-87fe-6c81253652a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:25 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 1073741824 Jul 07 17:54:25 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:25 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Volume volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 (2f44462a-5ed6-4215-9c71-2ba29b76e7b7): created successfully Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3072f5-9af9-4f94-87fe-6c81253652a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (3b82f039-4689-47a7-988b-877bbda70c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f274a2eb-0a9c-4b17-97b5-8baa97e40c34 tempest-VolumesActionsTest-227891384 None] Created volume successfully. Jul 07 17:54:26 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 1073741824" returned: 0 in 0.899s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:26 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 Jul 07 17:54:26 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Flow 'volume_create_manager' (f6372cb9-6ebc-4702-baa9-6569411f52cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9ce76b-60eb-454e-83c7-5c9b1fa54e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b9ce76b-60eb-454e-83c7-5c9b1fa54e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2080652835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d56dd672-6a1a-4d7e-91fb-466b183c20c0,host='devstack@QuobyteHD#QuobyteHD',id=41a8b0e3-4e1b-4990-8ae1-00066bea517c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3c6260ea4b4502b64b0078ad83786d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:27Z,use_quota=True,user_id='3f0e29b741ed402d9cd8c5eaa30f7cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f445ca3-b46d-4f7c-813c-2408778edbfc),volume_type_id=8f445ca3-b46d-4f7c-813c-2408778edbfc)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2554f5-c724-4844-8ed0-99e59b51f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2554f5-c724-4844-8ed0-99e59b51f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0bc669-6011-423a-8bc5-a00374cd10f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0bc669-6011-423a-8bc5-a00374cd10f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a8b0e3-4e1b-4990-8ae1-00066bea517c', 'volume_name': 'volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93857c6a-de23-4d37-98f9-13d2e0f40f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93857c6a-de23-4d37-98f9-13d2e0f40f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fb67d8-b0b2-458a-bfaf-517519f75c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:26 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Volume 41a8b0e3-4e1b-4990-8ae1-00066bea517c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c', 'volume_size': 1} Jul 07 17:54:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-2f44462a-5ed6-4215-9c71-2ba29b76e7b7-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Lock "cinder-2f44462a-5ed6-4215-9c71-2ba29b76e7b7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-quobyte-2f44462a-5ed6-4215-9c71-2ba29b76e7b7" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Lock "cinder-quobyte-2f44462a-5ed6-4215-9c71-2ba29b76e7b7" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f555388b-2b09-4ede-899f-8af93a2ff742]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:27 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 Jul 07 17:54:27 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:27 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19" returned: 0 in 0.854s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d56dd672-6a1a-4d7e-91fb-466b183c20c0,created_at=2026-07-07T15:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2080652835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d56dd672-6a1a-4d7e-91fb-466b183c20c0,host='devstack@QuobyteHD#QuobyteHD',id=41a8b0e3-4e1b-4990-8ae1-00066bea517c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3c6260ea4b4502b64b0078ad83786d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:27Z,use_quota=True,user_id='3f0e29b741ed402d9cd8c5eaa30f7cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f445ca3-b46d-4f7c-813c-2408778edbfc),volume_type_id=8f445ca3-b46d-4f7c-813c-2408778edbfc)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Creating volume 41a8b0e3-4e1b-4990-8ae1-00066bea517c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:27 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1153d41f-488e-4383-b0c3-fb68fb4771ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:27 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c 1073741824 Jul 07 17:54:27 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdcb3ec-9e37-45ee-9460-0fbc87893f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:27 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Volume volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 (044d97f7-8e9e-4bfa-b6b4-eb388982ec19): created successfully Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdcb3ec-9e37-45ee-9460-0fbc87893f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Flow 'volume_create_manager' (0335a193-74c8-4852-8be5-e0cb5e3938ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:27 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9d7c6a90-b742-4818-83d2-ccaf984c5332 tempest-ServersNegativeTestJSON-333818181 None] Created volume successfully. Jul 07 17:54:28 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7" returned: 0 in 0.887s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:28 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7 Jul 07 17:54:28 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:28 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c 1073741824" returned: 0 in 0.918s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:28 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c Jul 07 17:54:28 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:28 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2f44462a-5ed6-4215-9c71-2ba29b76e7b7" returned: 0 in 0.681s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Lock "cinder-quobyte-2f44462a-5ed6-4215-9c71-2ba29b76e7b7" released by "delete_volume" :: held 1.635s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "cinder-044d97f7-8e9e-4bfa-b6b4-eb388982ec19-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Created reservations ['1deec14b-3229-460c-b6c8-09f3a351d7ee', '4a0b4fae-f63e-436c-8e45-fa33cd040859', '87071631-5539-429d-9538-a770a6a42a07', '2e27c532-3ddd-4195-84ea-735a0abe6281'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Lock "cinder-044d97f7-8e9e-4bfa-b6b4-eb388982ec19-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "cinder-quobyte-044d97f7-8e9e-4bfa-b6b4-eb388982ec19" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Lock "cinder-quobyte-044d97f7-8e9e-4bfa-b6b4-eb388982ec19" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cea8a8f-7098-45a1-9e73-3e000c626341]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:28 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:28 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:29 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 Jul 07 17:54:29 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:29 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c" returned: 0 in 0.789s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fb67d8-b0b2-458a-bfaf-517519f75c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b8eb20-9af8-49a5-b15d-6ac08f840ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:29 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Volume volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c (41a8b0e3-4e1b-4990-8ae1-00066bea517c): created successfully Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b8eb20-9af8-49a5-b15d-6ac08f840ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Flow 'volume_create_manager' (f6372cb9-6ebc-4702-baa9-6569411f52cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bdd54f86-d271-4ee6-a5ed-0751be2a359d tempest-GroupSnapshotsTest-1654924055 None] Created volume successfully. Jul 07 17:54:29 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.815s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Deleted volume successfully. Jul 07 17:54:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-549b5d99-e6e9-432c-8ae3-008e485d024b tempest-VolumesActionsTest-235115780 None] Lock "cinder-2f44462a-5ed6-4215-9c71-2ba29b76e7b7-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:30 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19" returned: 0 in 1.021s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:30 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19 Jul 07 17:54:30 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (3b9cbfe5-6f8a-47fb-892a-3c7d24cb4e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a300688f-ccbf-454a-853f-08bed7522044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a300688f-ccbf-454a-853f-08bed7522044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-104527114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5060534-d6e8-4640-9284-8caec5c78c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:30Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0b4bdd-6e07-460c-bdb6-6bbb6ce9719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0b4bdd-6e07-460c-bdb6-6bbb6ce9719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8e9288-32e4-4ef9-9e1d-13bb16dd849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa8e9288-32e4-4ef9-9e1d-13bb16dd849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5060534-d6e8-4640-9284-8caec5c78c46', 'volume_name': 'volume-e5060534-d6e8-4640-9284-8caec5c78c46', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098d8578-43ff-485c-ae10-786c4a9175ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098d8578-43ff-485c-ae10-786c4a9175ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba150cb-305f-4868-a704-b1757a36905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:30 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Volume e5060534-d6e8-4640-9284-8caec5c78c46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5060534-d6e8-4640-9284-8caec5c78c46', 'volume_size': 1} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-104527114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5060534-d6e8-4640-9284-8caec5c78c46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:30Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Creating volume e5060534-d6e8-4640-9284-8caec5c78c46 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:30 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:30 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 1073741824 Jul 07 17:54:30 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:31 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-044d97f7-8e9e-4bfa-b6b4-eb388982ec19" returned: 0 in 1.275s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Lock "cinder-quobyte-044d97f7-8e9e-4bfa-b6b4-eb388982ec19" released by "delete_volume" :: held 2.475s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Created reservations ['b987dcd8-1bca-4a5e-9e8b-df9ca4fc2d3e', 'ffcc2e7d-a075-42b8-9471-b5977adbee49', '89986249-6b53-45d5-ba34-ee0424202182', '3bbc3dc6-ff81-427d-8381-ffca594419da'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:31 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 1073741824" returned: 0 in 1.696s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:31 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:31 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Flow 'volume_create_manager' (e003e3aa-0f2b-4343-9d3e-4fd64fad963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b3b65a-2c51-4fa0-8208-91679f3dcae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b3b65a-2c51-4fa0-8208-91679f3dcae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907049551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d56dd672-6a1a-4d7e-91fb-466b183c20c0,host='devstack@QuobyteHD#QuobyteHD',id=ac25a8db-f583-4ee0-80c3-592139f93d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3c6260ea4b4502b64b0078ad83786d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:32Z,use_quota=True,user_id='3f0e29b741ed402d9cd8c5eaa30f7cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f445ca3-b46d-4f7c-813c-2408778edbfc),volume_type_id=8f445ca3-b46d-4f7c-813c-2408778edbfc)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83fe36c-0583-47d3-9a1a-270ea2d2d8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83fe36c-0583-47d3-9a1a-270ea2d2d8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbe27a5-ebd4-442b-ba9d-c9b502673699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bbe27a5-ebd4-442b-ba9d-c9b502673699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac25a8db-f583-4ee0-80c3-592139f93d27', 'volume_name': 'volume-ac25a8db-f583-4ee0-80c3-592139f93d27', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2515cb3f-61c1-4c85-83e0-4978678e3f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2515cb3f-61c1-4c85-83e0-4978678e3f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84974367-613f-488a-a334-93e7253c2bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:32 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Volume ac25a8db-f583-4ee0-80c3-592139f93d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac25a8db-f583-4ee0-80c3-592139f93d27', 'volume_size': 1} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:32 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 Jul 07 17:54:32 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "cinder-ee3c42d8-581b-403d-99f8-2706dc18b1be-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Lock "cinder-ee3c42d8-581b-403d-99f8-2706dc18b1be-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:32 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.921s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "cinder-quobyte-ee3c42d8-581b-403d-99f8-2706dc18b1be" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:32 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Deleted volume successfully. Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Lock "cinder-quobyte-ee3c42d8-581b-403d-99f8-2706dc18b1be" acquired by "delete_volume" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bcea4be1-2b01-451b-b9d9-2ab0583a4bd8 tempest-ServersNegativeTestJSON-333818181 None] Lock "cinder-044d97f7-8e9e-4bfa-b6b4-eb388982ec19-delete_volume" released by "delete_volume" :: held 3.926s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[22907dca-1b21-486c-9ac2-230d59b62ad1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:32 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be Jul 07 17:54:32 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:33 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46" returned: 0 in 1.004s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] <== create_volume: return (2865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.867s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d56dd672-6a1a-4d7e-91fb-466b183c20c0,created_at=2026-07-07T15:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907049551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d56dd672-6a1a-4d7e-91fb-466b183c20c0,host='devstack@QuobyteHD#QuobyteHD',id=ac25a8db-f583-4ee0-80c3-592139f93d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3c6260ea4b4502b64b0078ad83786d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:32Z,use_quota=True,user_id='3f0e29b741ed402d9cd8c5eaa30f7cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f445ca3-b46d-4f7c-813c-2408778edbfc),volume_type_id=8f445ca3-b46d-4f7c-813c-2408778edbfc)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Creating volume ac25a8db-f583-4ee0-80c3-592139f93d27 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:33 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba150cb-305f-4868-a704-b1757a36905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5060534-d6e8-4640-9284-8caec5c78c46', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:33 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 1073741824 Jul 07 17:54:33 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191c9d2e-e5a3-47bc-8956-7df21094d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:33 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Volume volume-e5060534-d6e8-4640-9284-8caec5c78c46 (e5060534-d6e8-4640-9284-8caec5c78c46): created successfully Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191c9d2e-e5a3-47bc-8956-7df21094d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (3b9cbfe5-6f8a-47fb-892a-3c7d24cb4e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7a67ca00-f6af-4fbc-a8ed-59c9e64a0210 tempest-VolumesActionsTest-227891384 None] Created volume successfully. Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-e5060534-d6e8-4640-9284-8caec5c78c46-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Lock "cinder-e5060534-d6e8-4640-9284-8caec5c78c46-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Acquiring lock "cinder-quobyte-e5060534-d6e8-4640-9284-8caec5c78c46" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Lock "cinder-quobyte-e5060534-d6e8-4640-9284-8caec5c78c46" acquired by "delete_volume" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c627549-8326-4fc6-ae66-03e450c7e6d8]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:33 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 Jul 07 17:54:33 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:33 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be" returned: 0 in 1.081s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:33 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be Jul 07 17:54:33 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:34 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 1073741824" returned: 0 in 1.195s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:34 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 Jul 07 17:54:34 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:34 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46" returned: 0 in 0.978s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:34 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ee3c42d8-581b-403d-99f8-2706dc18b1be" returned: 0 in 0.765s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:34 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46 Jul 07 17:54:34 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Lock "cinder-quobyte-ee3c42d8-581b-403d-99f8-2706dc18b1be" released by "delete_volume" :: held 1.909s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Created reservations ['2510ba5e-66e5-40a1-a588-4aa3733f7c7c', 'f8e0110d-76d8-4817-a826-0287df0128f7', 'cec50186-616f-4784-bdc3-576ddb2552e2', 'eece0fa8-4443-4a9f-8500-52fdd047f41f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:34 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:34 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:35 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27" returned: 0 in 0.902s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84974367-613f-488a-a334-93e7253c2bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac25a8db-f583-4ee0-80c3-592139f93d27', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b3284-bbc8-45e8-8e01-d26d1f0406ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:35 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Volume volume-ac25a8db-f583-4ee0-80c3-592139f93d27 (ac25a8db-f583-4ee0-80c3-592139f93d27): created successfully Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277b3284-bbc8-45e8-8e01-d26d1f0406ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Flow 'volume_create_manager' (e003e3aa-0f2b-4343-9d3e-4fd64fad963b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:35 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d5c7cd89-0c4a-4b1a-a4c1-8661d5fc085e tempest-GroupSnapshotsTest-1654924055 None] Created volume successfully. Jul 07 17:54:35 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e5060534-d6e8-4640-9284-8caec5c78c46" returned: 0 in 0.741s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Lock "cinder-quobyte-e5060534-d6e8-4640-9284-8caec5c78c46" released by "delete_volume" :: held 1.765s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Created reservations ['64e1c985-e580-4749-b6dd-615c5c934f88', 'db75d415-0cf3-4ac0-9fa4-8b1fb813bd2d', '1199022a-aa80-4c7a-94f4-9cbcb494120b', 'cd89e76f-2447-4c55-9033-dd616cad6be2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:35 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:35 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:35 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.999s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:35 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Deleted volume successfully. Jul 07 17:54:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2173e42d-47f1-4b2b-9113-0cce9ac634e5 tempest-ServersNegativeTestJSON-333818181 None] Lock "cinder-ee3c42d8-581b-403d-99f8-2706dc18b1be-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:35 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6f45c9e4-c6d8-4cd1-8296-51b1ea8d7cf7 tempest-GroupSnapshotsTest-1654924055 None] Update group completed successfully. Jul 07 17:54:36 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.922s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:36 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Deleted volume successfully. Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (45706761-75e1-4e35-9530-b6428ebc81e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2065d946-e654-404f-a92b-61cdd6c34ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-88552929-3479-4a63-af71-6bf40b42b8e6 tempest-VolumesActionsTest-235115780 None] Lock "cinder-e5060534-d6e8-4640-9284-8caec5c78c46-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2065d946-e654-404f-a92b-61cdd6c34ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-91773128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182085fc-7c90-493f-a221-b87666a03d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:36Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30a923f-493c-45c3-a9ad-a3a504100ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30a923f-493c-45c3-a9ad-a3a504100ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e4241e-2889-472a-b814-7ddc1d1e0e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e4241e-2889-472a-b814-7ddc1d1e0e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182085fc-7c90-493f-a221-b87666a03d7c', 'volume_name': 'volume-182085fc-7c90-493f-a221-b87666a03d7c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ea7daa-478e-40b2-bdd6-00411d33e7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ea7daa-478e-40b2-bdd6-00411d33e7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904075d6-0e61-408c-98cd-672371798a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:36 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Volume 182085fc-7c90-493f-a221-b87666a03d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182085fc-7c90-493f-a221-b87666a03d7c', 'volume_size': 1} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-91773128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182085fc-7c90-493f-a221-b87666a03d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7179285a7c824209932078369d3d257a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:36Z,use_quota=True,user_id='bbec7cc4b3bf48c0a9824e5a999ea3bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Creating volume 182085fc-7c90-493f-a221-b87666a03d7c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:36 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:36 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c 1073741824 Jul 07 17:54:36 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0d90e177-a969-4a2e-ab9e-047f62663d9d tempest-GroupSnapshotsTest-1654924055 None] Update group completed successfully. Jul 07 17:54:37 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c 1073741824" returned: 0 in 1.375s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:38 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c Jul 07 17:54:38 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:38 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3e82aa64-3668-4712-b681-4a85ece6b63f tempest-GroupSnapshotsTest-1654924055 None] Update group completed successfully. Jul 07 17:54:38 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c" returned: 0 in 0.850s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.307s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (904075d6-0e61-408c-98cd-672371798a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182085fc-7c90-493f-a221-b87666a03d7c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d302f0-cd94-45af-91fc-24282ca00613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:38 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Volume volume-182085fc-7c90-493f-a221-b87666a03d7c (182085fc-7c90-493f-a221-b87666a03d7c): created successfully Jul 07 17:54:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d302f0-cd94-45af-91fc-24282ca00613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Flow 'volume_create_manager' (45706761-75e1-4e35-9530-b6428ebc81e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:38 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-766f61ad-a6dd-4089-972e-5811c5753e27 tempest-VolumesActionsTest-227891384 None] Created volume successfully. Jul 07 17:54:39 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-80f4b18a-a4e4-49c0-a805-7db0bf013da3 tempest-GroupSnapshotsTest-1654924055 None] Update group completed successfully. Jul 07 17:54:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Acquiring lock "cinder-182085fc-7c90-493f-a221-b87666a03d7c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Lock "cinder-182085fc-7c90-493f-a221-b87666a03d7c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Acquiring lock "cinder-quobyte-182085fc-7c90-493f-a221-b87666a03d7c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Lock "cinder-quobyte-182085fc-7c90-493f-a221-b87666a03d7c" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:40 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[195f5485-630b-41eb-8655-60ab5eb43b90]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:40 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c Jul 07 17:54:40 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] GroupSnapshot 57ba0840-4530-4171-b15c-2c8d2c665219: creating. Jul 07 17:54:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Group snapshot 57ba0840-4530-4171-b15c-2c8d2c665219: creating. {{(pid=87228) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 07 17:54:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Creating offline snapshot 751f993c-7173-46d3-af0b-92b48e9124e7 of volume 41a8b0e3-4e1b-4990-8ae1-00066bea517c {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:54:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccce794-e73c-419c-82ad-ece426d3c452]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:41 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c" returned: 0 in 1.082s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:41 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c Jul 07 17:54:41 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c Jul 07 17:54:41 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:41 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:42 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:42 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c" returned: 0 in 1.155s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-182085fc-7c90-493f-a221-b87666a03d7c" returned: 0 in 1.027s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:42 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 1G Jul 07 17:54:42 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Lock "cinder-quobyte-182085fc-7c90-493f-a221-b87666a03d7c" released by "delete_volume" :: held 2.212s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Created reservations ['ab250b08-4e0f-4c80-a570-71cbb8619b4c', '52f301c0-d5bc-4a50-8ab3-c741c8ffdb87', '21bffecb-9334-444e-bd8b-6ac6ba2d3270', '66648d23-f88d-44ad-ac42-00375a0a88ca'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:43 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:54:43 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:44 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 1G" returned: 0 in 1.326s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:44 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.099s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:44 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:44 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 Jul 07 17:54:44 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Deleted volume successfully. Jul 07 17:54:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d793e58-f0b2-4fae-9805-13d30818d885 tempest-VolumesActionsTest-227891384 None] Lock "cinder-182085fc-7c90-493f-a221-b87666a03d7c-delete_volume" released by "delete_volume" :: held 3.619s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:45 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7" returned: 0 in 1.057s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:45 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:54:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:45 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 Jul 07 17:54:45 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:45 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7" returned: 0 in 0.875s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:46 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.info Jul 07 17:54:46 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:46 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.info" returned: 0 in 0.848s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:46 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:54:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:46 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.info Jul 07 17:54:46 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:48 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.info" returned: 0 in 1.267s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.678s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Creating offline snapshot b0d5b028-1596-49f8-842a-515060843594 of volume ac25a8db-f583-4ee0-80c3-592139f93d27 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:54:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a4672-c5ce-4e00-9f7c-0de2734ac0e9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:48 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 Jul 07 17:54:48 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:49 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27" returned: 0 in 1.417s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:49 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 1G Jul 07 17:54:49 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:50 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 1G" returned: 0 in 1.274s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac25a8db-f583-4ee0-80c3-592139f93d27 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:50 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac25a8db-f583-4ee0-80c3-592139f93d27 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 Jul 07 17:54:50 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:51 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac25a8db-f583-4ee0-80c3-592139f93d27 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594" returned: 0 in 0.892s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:51 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:54:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:51 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 Jul 07 17:54:51 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:52 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594" returned: 0 in 0.985s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:52 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.info Jul 07 17:54:52 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Flow 'volume_create_manager' (b4221181-1406-4c1f-adf9-887adfb151e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de223eb-df2b-4c38-a7e2-83005d4f587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:53 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de223eb-df2b-4c38-a7e2-83005d4f587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-4026953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6e1698-749a-4161-a164-15654f4a9f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e7e79e1fc54ecdbec57c890e018c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:54Z,use_quota=True,user_id='c4b5f05a6830438aad4a03d7585013e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1857ba1c-9b70-4f28-94bb-5f79cd375887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1857ba1c-9b70-4f28-94bb-5f79cd375887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2853f6-25a7-4c75-9a64-6983b19ee891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f2853f6-25a7-4c75-9a64-6983b19ee891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6e1698-749a-4161-a164-15654f4a9f8f', 'volume_name': 'volume-9d6e1698-749a-4161-a164-15654f4a9f8f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1c794d-537b-4924-8749-e22857b4df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd1c794d-537b-4924-8749-e22857b4df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2d887b-2c1d-49ad-8e74-e48cf8729a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:53 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Volume 9d6e1698-749a-4161-a164-15654f4a9f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6e1698-749a-4161-a164-15654f4a9f8f', 'volume_size': 1} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.info" returned: 0 in 0.993s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:53 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:54:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:53 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.info Jul 07 17:54:53 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:54 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.info" returned: 0 in 0.730s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.405s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-4026953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6e1698-749a-4161-a164-15654f4a9f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32e7e79e1fc54ecdbec57c890e018c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:54:54Z,use_quota=True,user_id='c4b5f05a6830438aad4a03d7585013e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Creating volume 9d6e1698-749a-4161-a164-15654f4a9f8f {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:54:54 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:54:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:54 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f 1073741824 Jul 07 17:54:54 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1b19a3d4-bd5f-4989-a410-421c266d0d35 tempest-GroupSnapshotsTest-1654924055 None] group_snapshot 57ba0840-4530-4171-b15c-2c8d2c665219: created successfully Jul 07 17:54:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] group_snapshot 57ba0840-4530-4171-b15c-2c8d2c665219: deleting Jul 07 17:54:55 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f 1073741824" returned: 0 in 0.979s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] group_snapshot 57ba0840-4530-4171-b15c-2c8d2c665219: deleting {{(pid=87228) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-41a8b0e3-4e1b-4990-8ae1-00066bea517c" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-41a8b0e3-4e1b-4990-8ae1-00066bea517c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-751f993c-7173-46d3-af0b-92b48e9124e7" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:55 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f Jul 07 17:54:55 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-751f993c-7173-46d3-af0b-92b48e9124e7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Deleting offline snapshot 751f993c-7173-46d3-af0b-92b48e9124e7 of volume 41a8b0e3-4e1b-4990-8ae1-00066bea517c {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] snapshot_file for this snap is: volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5053e222-9e62-4b6f-bc03-1e2bee855f0e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:55 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 Jul 07 17:54:55 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:56 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f" returned: 0 in 0.828s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2d887b-2c1d-49ad-8e74-e48cf8729a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6e1698-749a-4161-a164-15654f4a9f8f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed82c9c-d239-427b-ac30-e63337ca82cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:54:56 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Volume volume-9d6e1698-749a-4161-a164-15654f4a9f8f (9d6e1698-749a-4161-a164-15654f4a9f8f): created successfully Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed82c9c-d239-427b-ac30-e63337ca82cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Flow 'volume_create_manager' (b4221181-1406-4c1f-adf9-887adfb151e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:54:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-c9808055-7ca1-45ed-928b-f7ce4f3064ad req-ead25ba7-b1c4-4785-8457-f6f0e1c52675 tempest-VolumesSnapshotsTestJSON-723373479 None] Created volume successfully. Jul 07 17:54:56 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7" returned: 0 in 0.946s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d6b428-512b-4b09-9f0c-49387f35ef47]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:56 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c Jul 07 17:54:56 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:54:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:54:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Creating offline snapshot 7d405586-67d5-4731-955f-186680c89be1 of volume 9d6e1698-749a-4161-a164-15654f4a9f8f {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:54:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad7a9f1-4a08-40d1-9258-4d33bea69955]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:57 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f Jul 07 17:54:57 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:57 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c" returned: 0 in 0.908s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:57 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 Jul 07 17:54:57 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:58 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f" returned: 0 in 1.035s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:58 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 1G Jul 07 17:54:58 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:58 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7" returned: 0 in 0.999s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:58 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7 Jul 07 17:54:58 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:59 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c.751f993c-7173-46d3-af0b-92b48e9124e7" returned: 0 in 0.889s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:59 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 1G" returned: 0 in 1.094s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6e1698-749a-4161-a164-15654f4a9f8f -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-751f993c-7173-46d3-af0b-92b48e9124e7" released by "_delete_snapshot" :: held 3.908s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-41a8b0e3-4e1b-4990-8ae1-00066bea517c" released by "delete_snapshot" :: held 3.945s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:54:59 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6e1698-749a-4161-a164-15654f4a9f8f -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 Jul 07 17:54:59 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-ac25a8db-f583-4ee0-80c3-592139f93d27" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-ac25a8db-f583-4ee0-80c3-592139f93d27" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-b0d5b028-1596-49f8-842a-515060843594" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-b0d5b028-1596-49f8-842a-515060843594" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Deleting offline snapshot b0d5b028-1596-49f8-842a-515060843594 of volume ac25a8db-f583-4ee0-80c3-592139f93d27 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] snapshot_file for this snap is: volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa57fdf7-e3b1-46e9-ac01-bfba9a3015b8]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:54:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:59 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 Jul 07 17:54:59 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:00 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6e1698-749a-4161-a164-15654f4a9f8f -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1" returned: 0 in 0.866s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:00 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 is being set with open permissions: ugo+rw Jul 07 17:55:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:00 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 Jul 07 17:55:00 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:00 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594" returned: 0 in 1.066s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac25a8db-f583-4ee0-80c3-592139f93d27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:55:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35ad7c2-954a-4b15-b5c4-5da86412ac9c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:00 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 Jul 07 17:55:00 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:01 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1" returned: 0 in 0.728s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:01 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.info Jul 07 17:55:01 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:01 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27" returned: 0 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:01 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 Jul 07 17:55:01 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:01 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.info" returned: 0 in 0.736s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:01 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.info is being set with open permissions: ugo+rw Jul 07 17:55:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:02 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.info Jul 07 17:55:02 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:02 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594" returned: 0 in 0.821s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:02 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594 Jul 07 17:55:02 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:02 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.info" returned: 0 in 0.790s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.397s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:02 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-e4b73232-307c-4147-8f52-79997083ea64 req-7d4b5d3a-f257-41d2-ad08-5554762843a6 tempest-VolumesSnapshotsTestJSON-723373479 None] Create snapshot completed successfully Jul 07 17:55:03 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27.b0d5b028-1596-49f8-842a-515060843594" returned: 0 in 0.699s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-b0d5b028-1596-49f8-842a-515060843594" released by "_delete_snapshot" :: held 3.587s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-ac25a8db-f583-4ee0-80c3-592139f93d27" released by "delete_snapshot" :: held 3.618s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:03 devstack cinder-volume[87228]: WARNING cinder.quota [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-255183898 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-255183898, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:03 devstack cinder-volume[87228]: WARNING cinder.quota [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-255183898 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-255183898, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['5157f7af-797e-4324-8864-4f0e5ebe6e56', '99da1740-1b94-4a49-a5c4-8d35ef50a61e', 'a98308e0-8a43-4b14-a7c3-68e9894a7ee1', '6a41a7dc-c823-4441-a097-c4da2eecdf93'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "cinder-7d405586-67d5-4731-955f-186680c89be1-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['d01f2b1b-c50e-4d44-9242-8a86e03dac08', '151712a7-aad5-4b1f-a365-babe7ac6d18a', 'daa1bc0f-685a-480e-9149-35db0d9b23dd', 'ebb2fc45-b906-4d88-a444-d1bef58fcf19'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-7d405586-67d5-4731-955f-186680c89be1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "cinder-quobyte-9d6e1698-749a-4161-a164-15654f4a9f8f" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-quobyte-9d6e1698-749a-4161-a164-15654f4a9f8f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "cinder-quobyte-7d405586-67d5-4731-955f-186680c89be1" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-quobyte-7d405586-67d5-4731-955f-186680c89be1" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Deleting offline snapshot 7d405586-67d5-4731-955f-186680c89be1 of volume 9d6e1698-749a-4161-a164-15654f4a9f8f {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] snapshot_file for this snap is: volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:55:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-91026f64-3787-4377-83a6-64353bbb122b tempest-GroupSnapshotsTest-1654924055 None] group_snapshot 57ba0840-4530-4171-b15c-2c8d2c665219: deleted successfully Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50b29d2-eb6e-4318-b06a-3d6578a910bf]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:03 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 Jul 07 17:55:03 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:04 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1" returned: 0 in 0.885s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d6e1698-749a-4161-a164-15654f4a9f8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:55:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e558c6f8-c113-43c0-93d5-50a39b3a780d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:04 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f Jul 07 17:55:04 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Flow 'volume_create_manager' (aa81cd4d-bb11-4beb-8dbf-e3df881c221e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9555a51b-8bac-41a8-a17f-fce63bdc708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9555a51b-8bac-41a8-a17f-fce63bdc708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1909175243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef3df6f-6910-4d2f-8255-b5d2a6dcb118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fafdd4d9a14587b713be69956cbc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:05Z,use_quota=True,user_id='cdde4d76f61e44b5aaa2ee91c588ddfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfe74f1-0326-4b81-bf24-b364fd49105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfe74f1-0326-4b81-bf24-b364fd49105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c80825e-10ee-402d-8c44-ac3108771b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c80825e-10ee-402d-8c44-ac3108771b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef3df6f-6910-4d2f-8255-b5d2a6dcb118', 'volume_name': 'volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759c721c-ea53-438e-a468-218cd264254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (759c721c-ea53-438e-a468-218cd264254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b226ac4-512c-4b09-8423-4407219036b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Volume 6ef3df6f-6910-4d2f-8255-b5d2a6dcb118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118', 'volume_size': 1} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1909175243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef3df6f-6910-4d2f-8255-b5d2a6dcb118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75fafdd4d9a14587b713be69956cbc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:05Z,use_quota=True,user_id='cdde4d76f61e44b5aaa2ee91c588ddfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Creating volume 6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:05 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-41a8b0e3-4e1b-4990-8ae1-00066bea517c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-41a8b0e3-4e1b-4990-8ae1-00066bea517c" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:05 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 1073741824 Jul 07 17:55:05 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd82e66-38bd-4c12-a807-10dfb663dcb4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:05 devstack sudo[94812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c Jul 07 17:55:05 devstack sudo[94812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Flow 'volume_create_manager' (57ad20e0-985d-498d-94ea-b834be39ee40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d456fb-ac59-4620-a7b2-affa947ecd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d456fb-ac59-4620-a7b2-affa947ecd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1753805526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d621008a-ae87-444e-ad9c-e9c7914f4b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972427dcb6d9477b87a46d5566dffa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:06Z,use_quota=True,user_id='e2151cd943894b74bf821245b6c1d9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f83089d-5f62-4e82-ba6d-f96f5d06a368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f83089d-5f62-4e82-ba6d-f96f5d06a368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4a9cee-bf8d-458c-aed0-42383bc2a5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4a9cee-bf8d-458c-aed0-42383bc2a5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd621008a-ae87-444e-ad9c-e9c7914f4b97', 'volume_name': 'volume-d621008a-ae87-444e-ad9c-e9c7914f4b97', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c046f56c-626b-432b-8452-4deb975311a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c046f56c-626b-432b-8452-4deb975311a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b540c8-fe6b-4b8b-acc5-bea5a4a1b97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:05 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Volume d621008a-ae87-444e-ad9c-e9c7914f4b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d621008a-ae87-444e-ad9c-e9c7914f4b97', 'volume_size': 1} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:05 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f" returned: 0 in 1.081s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:05 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 Jul 07 17:55:05 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:06 devstack sudo[94812]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:06 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c" returned: 0 in 0.873s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 1073741824" returned: 0 in 1.033s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=120,cinder:UPDATE=144,cinder:INSERT=32,cinder:DELETE=6 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=133,cinder:SELECT=120,cinder:DELETE=12,cinder:INSERT=31 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:55:06 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c Jul 07 17:55:06 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:06 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 Jul 07 17:55:06 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:06 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1" returned: 0 in 0.893s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:06 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1 Jul 07 17:55:06 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:06 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-41a8b0e3-4e1b-4990-8ae1-00066bea517c" returned: 0 in 0.672s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-41a8b0e3-4e1b-4990-8ae1-00066bea517c" released by "delete_volume" :: held 1.656s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-ac25a8db-f583-4ee0-80c3-592139f93d27" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-ac25a8db-f583-4ee0-80c3-592139f93d27" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:06 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" returned: 0 in 0.696s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.334s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1753805526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d621008a-ae87-444e-ad9c-e9c7914f4b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972427dcb6d9477b87a46d5566dffa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:06Z,use_quota=True,user_id='e2151cd943894b74bf821245b6c1d9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Creating volume d621008a-ae87-444e-ad9c-e9c7914f4b97 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:06 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f03231-a565-4647-a99d-8c23ace4c9ca]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:07 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 1073741824 Jul 07 17:55:07 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b226ac4-512c-4b09-8423-4407219036b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe49627d-b74b-432c-bcc6-b4bc69fea7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:07 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Volume volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 (6ef3df6f-6910-4d2f-8255-b5d2a6dcb118): created successfully Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe49627d-b74b-432c-bcc6-b4bc69fea7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Flow 'volume_create_manager' (aa81cd4d-bb11-4beb-8dbf-e3df881c221e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-114aede0-e9db-4dca-a1f5-a25ff6d3bc85 tempest-SnapshotMetadataTestJSON-1894587322 None] Created volume successfully. Jul 07 17:55:07 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 Jul 07 17:55:07 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:07 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f.7d405586-67d5-4731-955f-186680c89be1" returned: 0 in 0.834s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-quobyte-7d405586-67d5-4731-955f-186680c89be1" released by "_delete_snapshot" :: held 3.867s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-quobyte-9d6e1698-749a-4161-a164-15654f4a9f8f" released by "delete_snapshot" :: held 3.910s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:07 devstack cinder-volume[87228]: WARNING cinder.quota [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG cinder.quota [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Created reservations ['08995b3c-b9b5-4c65-bb91-3ffcce6ade51', 'e81376e3-3bdf-4811-8dfb-8845d2d72392', 'afec6226-962a-4798-b43e-16d2d71d7257', '42649772-d77b-4c62-858d-4dacd31b3410'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Delete snapshot completed successfully. Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-bbe37ce1-c115-45ea-aa93-53d5d03f2e62 req-c48778b8-43ce-4878-bf54-395bd7f53c82 tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-7d405586-67d5-4731-955f-186680c89be1-delete_snapshot" released by "delete_snapshot" :: held 4.217s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:07 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 1073741824" returned: 0 in 0.960s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:08 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 Jul 07 17:55:08 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:08 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27" returned: 0 in 1.024s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:08 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27 Jul 07 17:55:08 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "cinder-9d6e1698-749a-4161-a164-15654f4a9f8f-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-9d6e1698-749a-4161-a164-15654f4a9f8f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "cinder-quobyte-9d6e1698-749a-4161-a164-15654f4a9f8f" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-quobyte-9d6e1698-749a-4161-a164-15654f4a9f8f" acquired by "delete_volume" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0d10dd-6f14-4029-b9eb-78e0ab9fc577]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:08 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f Jul 07 17:55:08 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:08 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ac25a8db-f583-4ee0-80c3-592139f93d27" returned: 0 in 0.706s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-ac25a8db-f583-4ee0-80c3-592139f93d27" released by "delete_volume" :: held 1.852s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:08 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97" returned: 0 in 0.824s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.099s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b540c8-fe6b-4b8b-acc5-bea5a4a1b97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d621008a-ae87-444e-ad9c-e9c7914f4b97', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6797bec-67ba-4682-864b-4a733a627514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Creating offline snapshot 086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 of volume 6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:55:08 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Volume volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 (d621008a-ae87-444e-ad9c-e9c7914f4b97): created successfully Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6797bec-67ba-4682-864b-4a733a627514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Flow 'volume_create_manager' (57ad20e0-985d-498d-94ea-b834be39ee40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[77240f3a-2821-4cff-b80f-4e59128be317]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b2e95d50-3d64-4e1a-bc0b-c8eceb804e3b tempest-AttachVolumeTestJSON-357092893 None] Created volume successfully. Jul 07 17:55:08 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['f024a235-0167-48c0-901d-e7ddb49f27d8'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:09 devstack cinder-volume[87228]: WARNING cinder.quota [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-255183898 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-255183898, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['4037be62-2891-4911-b9fd-7730f60b3817', '56e58112-fb74-44fd-8cdd-bd61555dce14', '27ee10d7-7680-4132-bcdd-41bfd2be243e', 'f409361b-320c-4eb2-97df-b36f65ec7deb'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:09 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 Jul 07 17:55:09 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:09 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f" returned: 0 in 0.862s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['0c7d4ba8-9c28-4025-ae1f-b60aa309bccb', '5b88d8ca-637f-4bb1-9e28-b0cb05b43a0a', '98929c75-b37d-40b0-a0f3-e49f6c07237a', '5451df62-b388-4d75-a117-2d783c39b1a4'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:09 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f Jul 07 17:55:09 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:09 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:09 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:09 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" returned: 0 in 0.913s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:09 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 1G Jul 07 17:55:09 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:09 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9d6e1698-749a-4161-a164-15654f4a9f8f" returned: 0 in 0.843s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-quobyte-9d6e1698-749a-4161-a164-15654f4a9f8f" released by "delete_volume" :: held 1.783s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:10 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.739s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-85628d57-d04a-46be-b1cf-5bbdc12dde73 tempest-GroupSnapshotsTest-1654924055 None] Delete group completed successfully. Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG cinder.quota [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Created reservations ['efd96ef3-645e-4374-aa51-4b77a68c5ad8', '6d478f55-52d6-4cfb-8259-fdc8a6a74e44', 'debfb73f-bd80-4d5a-9025-c0e85543ca0a', '069386ba-ce52-4618-90fd-2cf25644fc3c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:10 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:10 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f61ce209-9a51-4b5d-809f-d99d37f92ab3 tempest-GroupSnapshotsTest-1654924055 None] Group tempest-GroupSnapshotsTest-Group-1649554281: creating Jul 07 17:55:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f61ce209-9a51-4b5d-809f-d99d37f92ab3 tempest-GroupSnapshotsTest-1654924055 None] Group tempest-GroupSnapshotsTest-Group-1649554281: created successfully Jul 07 17:55:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f61ce209-9a51-4b5d-809f-d99d37f92ab3 tempest-GroupSnapshotsTest-1654924055 None] Create group completed successfully. Jul 07 17:55:11 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.851s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:11 devstack cinder-volume[87228]: DEBUG cinder.manager [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:11 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Deleted volume successfully. Jul 07 17:55:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-3bf3611e-2227-44c4-ba9e-95cea043e628 req-8be42763-e025-4390-99eb-99576267de8c tempest-VolumesSnapshotsTestJSON-723373479 None] Lock "cinder-9d6e1698-749a-4161-a164-15654f4a9f8f-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:11 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 1G" returned: 0 in 1.252s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:11 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 Jul 07 17:55:11 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:11 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2" returned: 0 in 0.738s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:11 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 is being set with open permissions: ugo+rw Jul 07 17:55:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:11 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 Jul 07 17:55:11 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Flow 'volume_create_manager' (e66952a6-a385-4995-a752-ad8cbdfd6026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6647d3f-fdef-4a14-ab5a-4230e740e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6647d3f-fdef-4a14-ab5a-4230e740e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-839603856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6930cef-7029-4217-8b6b-b86e8b0097f7,host='devstack@QuobyteHD#QuobyteHD',id=2ef9f274-2b5e-468a-b6c3-01a6fbc45a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3c6260ea4b4502b64b0078ad83786d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:12Z,use_quota=True,user_id='3f0e29b741ed402d9cd8c5eaa30f7cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a26c65f-deb9-4b9e-b5af-b30a04ac2a98),volume_type_id=5a26c65f-deb9-4b9e-b5af-b30a04ac2a98)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e38401-ca80-44d3-875b-55f1365a4f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07e38401-ca80-44d3-875b-55f1365a4f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd756d26-8b36-4996-a3ee-23dfc83b2475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd756d26-8b36-4996-a3ee-23dfc83b2475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef9f274-2b5e-468a-b6c3-01a6fbc45a46', 'volume_name': 'volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea15aec4-9526-4613-8853-eac2cee7d26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea15aec4-9526-4613-8853-eac2cee7d26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e8590c-01bf-4120-9c0f-f84094086a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:12 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Volume 2ef9f274-2b5e-468a-b6c3-01a6fbc45a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46', 'volume_size': 1} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:12 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2" returned: 0 in 0.926s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:12 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.info Jul 07 17:55:12 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:13 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.info" returned: 0 in 0.694s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:13 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.info is being set with open permissions: ugo+rw Jul 07 17:55:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:13 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.info Jul 07 17:55:13 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-b9721bcf-0805-4e7d-9311-ea8a7a034484 req-d4bddedf-5806-45b0-ac12-f2040f722ab8 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:14 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.info" returned: 0 in 0.673s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.397s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d6930cef-7029-4217-8b6b-b86e8b0097f7,created_at=2026-07-07T15:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-839603856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6930cef-7029-4217-8b6b-b86e8b0097f7,host='devstack@QuobyteHD#QuobyteHD',id=2ef9f274-2b5e-468a-b6c3-01a6fbc45a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3c6260ea4b4502b64b0078ad83786d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:12Z,use_quota=True,user_id='3f0e29b741ed402d9cd8c5eaa30f7cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a26c65f-deb9-4b9e-b5af-b30a04ac2a98),volume_type_id=5a26c65f-deb9-4b9e-b5af-b30a04ac2a98)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Creating volume 2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:14 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:14 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 1073741824 Jul 07 17:55:14 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-98b1ad13-e27d-4c13-a2da-b57178bebb2a tempest-SnapshotMetadataTestJSON-1894587322 None] Create snapshot completed successfully Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Flow 'volume_create_manager' (dd3f865d-b55b-446c-8deb-ca580b680846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad5f02c-8c49-4b7e-930d-203faee0131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad5f02c-8c49-4b7e-930d-203faee0131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1152880384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95abe30-f844-4d92-9ec7-380dea7c6854,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='114ec587262d4f65a62684f44a688d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:15Z,use_quota=True,user_id='65a0b0a9668c403ea34c546f7a23b2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985a55aa-1116-42c9-8448-36e7cf2bba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985a55aa-1116-42c9-8448-36e7cf2bba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bac0a9-1618-405f-810f-9a28dbf889f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bac0a9-1618-405f-810f-9a28dbf889f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95abe30-f844-4d92-9ec7-380dea7c6854', 'volume_name': 'volume-f95abe30-f844-4d92-9ec7-380dea7c6854', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1379bc5c-98e8-4f18-93e6-cbd401da8b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1379bc5c-98e8-4f18-93e6-cbd401da8b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a278cd9b-7b48-4206-9b04-fb6fc2a232c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Volume f95abe30-f844-4d92-9ec7-380dea7c6854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95abe30-f844-4d92-9ec7-380dea7c6854', 'volume_size': 1} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:15 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 1073741824" returned: 0 in 0.954s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:15 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 Jul 07 17:55:15 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "cinder-086abcd7-e9e0-4dcd-9d47-0aa8fef733c2-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-086abcd7-e9e0-4dcd-9d47-0aa8fef733c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "cinder-quobyte-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:15 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" returned: 0 in 0.658s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-quobyte-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "cinder-quobyte-086abcd7-e9e0-4dcd-9d47-0aa8fef733c2" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-b9721bcf-0805-4e7d-9311-ea8a7a034484 req-d4bddedf-5806-45b0-ac12-f2040f722ab8 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.297s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16953e0-86d2-4974-a433-0752418913b2]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-b9721bcf-0805-4e7d-9311-ea8a7a034484 req-d4bddedf-5806-45b0-ac12-f2040f722ab8 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-quobyte-086abcd7-e9e0-4dcd-9d47-0aa8fef733c2" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Deleting offline snapshot 086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 of volume 6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] snapshot_file for this snap is: volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e8590c-01bf-4120-9c0f-f84094086a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6d39bb-96f0-46de-b3b5-5a4a5518c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[73052e7c-17c8-4acf-bb9d-0b8a356172ee]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Volume volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 (2ef9f274-2b5e-468a-b6c3-01a6fbc45a46): created successfully Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6d39bb-96f0-46de-b3b5-5a4a5518c180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Flow 'volume_create_manager' (e66952a6-a385-4995-a752-ad8cbdfd6026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1b974595-469d-4c8c-9969-365d4b75fa80 tempest-GroupSnapshotsTest-1654924055 None] Created volume successfully. Jul 07 17:55:16 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 Jul 07 17:55:16 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:16 devstack sudo[95333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 Jul 07 17:55:16 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] GroupSnapshot 1c65905f-a547-43ed-a9d7-87131f5b96bf: creating. Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Group snapshot 1c65905f-a547-43ed-a9d7-87131f5b96bf: creating. {{(pid=87228) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:16 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-b9721bcf-0805-4e7d-9311-ea8a7a034484 req-d4bddedf-5806-45b0-ac12-f2040f722ab8 tempest-AttachVolumeTestJSON-357092893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97" returned: 0 in 0.809s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-b9721bcf-0805-4e7d-9311-ea8a7a034484 req-d4bddedf-5806-45b0-ac12-f2040f722ab8 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1152880384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95abe30-f844-4d92-9ec7-380dea7c6854,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='114ec587262d4f65a62684f44a688d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:15Z,use_quota=True,user_id='65a0b0a9668c403ea34c546f7a23b2b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Creating volume f95abe30-f844-4d92-9ec7-380dea7c6854 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:16 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:16 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 1073741824 Jul 07 17:55:16 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:16 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2" returned: 0 in 0.809s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-b9721bcf-0805-4e7d-9311-ea8a7a034484 req-d4bddedf-5806-45b0-ac12-f2040f722ab8 tempest-AttachVolumeTestJSON-357092893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-d621008a-ae87-444e-ad9c-e9c7914f4b97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10c3eadd-61aa-4738-a23e-b835d8d3bd66', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64ad0fd-4846-4d60-ae03-1ea36d5cb717]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-b9721bcf-0805-4e7d-9311-ea8a7a034484 req-d4bddedf-5806-45b0-ac12-f2040f722ab8 tempest-AttachVolumeTestJSON-357092893 None] attachment_update completed successfully. Jul 07 17:55:16 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 Jul 07 17:55:16 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:17 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 1073741824" returned: 0 in 0.871s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:17 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" returned: 0 in 0.846s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:17 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 Jul 07 17:55:17 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:17 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 Jul 07 17:55:17 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:18 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854" returned: 0 in 0.677s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.853s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a278cd9b-7b48-4206-9b04-fb6fc2a232c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95abe30-f844-4d92-9ec7-380dea7c6854', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68b1548-d6ea-4469-b19a-5357af29e624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Creating offline snapshot 07ca0887-dc35-43a7-8c9b-2f953b3867e1 of volume 2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:55:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Volume volume-f95abe30-f844-4d92-9ec7-380dea7c6854 (f95abe30-f844-4d92-9ec7-380dea7c6854): created successfully Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68b1548-d6ea-4469-b19a-5357af29e624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Flow 'volume_create_manager' (dd3f865d-b55b-446c-8deb-ca580b680846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e80dfa4-dc01-4bdd-bb0b-569ce8bdd352]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:18 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-2215d5b8-c9db-49f1-a71d-21505ddebc5a req-05e8fa44-1ae5-4002-aca3-e55ee9dde99f tempest-VolumesGetTestJSON-1812167639 None] Created volume successfully. Jul 07 17:55:18 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2" returned: 0 in 0.837s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:18 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 Jul 07 17:55:18 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:18 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2 Jul 07 17:55:18 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:19 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118.086abcd7-e9e0-4dcd-9d47-0aa8fef733c2" returned: 0 in 0.690s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:19 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" returned: 0 in 0.825s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-quobyte-086abcd7-e9e0-4dcd-9d47-0aa8fef733c2" released by "_delete_snapshot" :: held 3.314s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-quobyte-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" released by "delete_snapshot" :: held 3.361s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:19 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 1G Jul 07 17:55:19 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Created reservations ['dd0201be-788e-493c-935a-776f2d11d7a9', 'd13ca30d-0278-4dd0-8752-0516ef4cd299', '5b56b774-d3f9-47f6-8f6f-af147e622ffa', '4f9ceb10-0584-43ce-8ffa-b434328eb09c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Delete snapshot completed successfully. Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e4df658e-e9e4-44e6-bba7-3e52b31e66b1 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-086abcd7-e9e0-4dcd-9d47-0aa8fef733c2-delete_snapshot" released by "delete_snapshot" :: held 3.522s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Acquiring lock "cinder-f95abe30-f844-4d92-9ec7-380dea7c6854-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Lock "cinder-f95abe30-f844-4d92-9ec7-380dea7c6854-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Acquiring lock "cinder-quobyte-f95abe30-f844-4d92-9ec7-380dea7c6854" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Lock "cinder-quobyte-f95abe30-f844-4d92-9ec7-380dea7c6854" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d98cf85-59fa-4dab-a6b9-4b29af1fcf5d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:19 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 Jul 07 17:55:19 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:20 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 1G" returned: 0 in 0.870s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:20 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 Jul 07 17:55:20 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "cinder-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "cinder-quobyte-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-quobyte-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" acquired by "delete_volume" :: waited 0.013s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4194f748-5eb3-4344-8f0f-9fc36b28d5c3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:20 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 Jul 07 17:55:20 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:20 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854" returned: 0 in 0.855s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:20 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854 Jul 07 17:55:20 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:20 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1" returned: 0 in 0.895s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:20 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:55:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:21 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 Jul 07 17:55:21 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:21 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" returned: 0 in 1.073s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:21 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118 Jul 07 17:55:21 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:21 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f95abe30-f844-4d92-9ec7-380dea7c6854" returned: 0 in 0.877s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Lock "cinder-quobyte-f95abe30-f844-4d92-9ec7-380dea7c6854" released by "delete_volume" :: held 1.775s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG cinder.quota [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Created reservations ['c21083f7-324e-4597-9eb9-ad8327f7ec41', 'b4e1b591-be6c-490b-95e7-dc324f1b1d87', '64361e48-7fb1-4620-8e22-974c676d0455', '387116fa-c96d-4ef5-9f4e-c8fe3d0a8549'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:21 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:21 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:21 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1" returned: 0 in 0.815s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:21 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.info Jul 07 17:55:21 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:22 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" returned: 0 in 0.736s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-quobyte-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118" released by "delete_volume" :: held 1.873s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Created reservations ['b64282cc-9400-40b9-a116-41367697c106', '24b165d2-491f-4981-abf7-51c830308787', '39bada54-93a2-479e-b274-fbad2101c5e8', '9e0325c7-4ca6-4fc7-8a6e-7b73179fde62'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:22 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:22 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:22 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.774s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG cinder.manager [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:22 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Deleted volume successfully. Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-1db5c648-3468-4b57-916e-9ddf619d3f62 req-6539aef5-bb71-4e59-82e2-ee9b2ce60870 tempest-VolumesGetTestJSON-1812167639 None] Lock "cinder-f95abe30-f844-4d92-9ec7-380dea7c6854-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:22 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.info" returned: 0 in 1.006s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:22 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:55:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:22 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.info Jul 07 17:55:22 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:23 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.006s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Deleted volume successfully. Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7979bc67-94b7-4bf4-8219-608709950ce6 tempest-SnapshotMetadataTestJSON-1894587322 None] Lock "cinder-6ef3df6f-6910-4d2f-8255-b5d2a6dcb118-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:23 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:23 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:23 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.info" returned: 0 in 1.022s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.615s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bfd72404-6ce9-4727-97d3-7bbf09756185 tempest-GroupSnapshotsTest-1654924055 None] group_snapshot 1c65905f-a547-43ed-a9d7-87131f5b96bf: created successfully Jul 07 17:55:24 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.961s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:55:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 8 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:55:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:55:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] group_snapshot 1c65905f-a547-43ed-a9d7-87131f5b96bf: deleting Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] group_snapshot 1c65905f-a547-43ed-a9d7-87131f5b96bf: deleting {{(pid=87228) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-07ca0887-dc35-43a7-8c9b-2f953b3867e1" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-07ca0887-dc35-43a7-8c9b-2f953b3867e1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Deleting offline snapshot 07ca0887-dc35-43a7-8c9b-2f953b3867e1 of volume 2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] snapshot_file for this snap is: volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d093f41-fd99-4a0d-8529-dfd207a7e916]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:25 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 Jul 07 17:55:25 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:26 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1" returned: 0 in 0.906s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdb1ccd-b91c-4645-91a6-375935aeb157]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:26 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 Jul 07 17:55:26 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Flow 'volume_create_manager' (f05ff40c-6be2-4e56-bf9d-beaa6a851f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489a21fa-643a-41ad-8b7b-8cb2b2d16cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489a21fa-643a-41ad-8b7b-8cb2b2d16cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1577756830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e654b4-7992-46a7-8d2c-b8d60b8a2d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b508e5f3f47847669a001ac3ba9187b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:27Z,use_quota=True,user_id='6c150be4a2dd43adbd73cb7bffd3ec22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ec8b4c-3331-420e-8b92-e5af4c9ff797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ec8b4c-3331-420e-8b92-e5af4c9ff797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda9035d-78d2-467e-bb7f-e247b4e3fba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda9035d-78d2-467e-bb7f-e247b4e3fba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5e654b4-7992-46a7-8d2c-b8d60b8a2d65', 'volume_name': 'volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ed577d-e126-40c3-99b3-52e7cd2a24e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ed577d-e126-40c3-99b3-52e7cd2a24e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031b6b19-6670-4ee1-88fd-b2e89fb8e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:26 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Volume a5e654b4-7992-46a7-8d2c-b8d60b8a2d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65', 'volume_size': 1} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1577756830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e654b4-7992-46a7-8d2c-b8d60b8a2d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b508e5f3f47847669a001ac3ba9187b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:27Z,use_quota=True,user_id='6c150be4a2dd43adbd73cb7bffd3ec22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Creating volume a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:26 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:26 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 1073741824 Jul 07 17:55:26 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:27 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" returned: 0 in 0.990s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:27 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 Jul 07 17:55:27 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:27 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a53153d3-4dab-4200-8ef5-6f87f8a047db tempest-GroupSnapshotsV319Test-836594397 None] Group tempest-GroupSnapshotsV319Test-Group-119534008: creating Jul 07 17:55:27 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a53153d3-4dab-4200-8ef5-6f87f8a047db tempest-GroupSnapshotsV319Test-836594397 None] Group tempest-GroupSnapshotsV319Test-Group-119534008: created successfully Jul 07 17:55:27 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a53153d3-4dab-4200-8ef5-6f87f8a047db tempest-GroupSnapshotsV319Test-836594397 None] Create group completed successfully. Jul 07 17:55:27 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 1073741824" returned: 0 in 0.986s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:28 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 Jul 07 17:55:28 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:28 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1" returned: 0 in 0.880s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:28 devstack sudo[95831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1 Jul 07 17:55:28 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:28 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65" returned: 0 in 0.693s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (031b6b19-6670-4ee1-88fd-b2e89fb8e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dde0864-bd8e-4723-9a16-f52d1aafa514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:28 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Volume volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 (a5e654b4-7992-46a7-8d2c-b8d60b8a2d65): created successfully Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dde0864-bd8e-4723-9a16-f52d1aafa514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Flow 'volume_create_manager' (f05ff40c-6be2-4e56-bf9d-beaa6a851f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-449b792b-49f9-46ee-a120-f34176e31ec1 tempest-VolumesMetadataTest-1273353306 None] Created volume successfully. Jul 07 17:55:29 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46.07ca0887-dc35-43a7-8c9b-2f953b3867e1" returned: 0 in 0.781s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-07ca0887-dc35-43a7-8c9b-2f953b3867e1" released by "_delete_snapshot" :: held 3.733s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" released by "delete_snapshot" :: held 3.772s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:29 devstack cinder-volume[87228]: WARNING cinder.quota [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-272569727 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-272569727, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:29 devstack cinder-volume[87228]: WARNING cinder.quota [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-272569727 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-272569727, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['91d5adf1-6a72-43bb-971b-46f445aef38c', '42e08c89-bb2c-4396-9580-dc39c1cf30a4', '11dd90f0-05a6-44b6-85df-fa404010ecd6', 'e8a0f938-8739-42b4-8600-88973dacfade'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Flow 'volume_create_manager' (8739f310-f5dc-4824-ba5b-354a19df086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24d48ca-8579-4f3a-8739-0f514f6ac499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-16ecfe46-b5e3-41c2-bc29-6df7339559ee tempest-GroupSnapshotsTest-1654924055 None] group_snapshot 1c65905f-a547-43ed-a9d7-87131f5b96bf: deleted successfully Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d24d48ca-8579-4f3a-8739-0f514f6ac499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-539830235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b1f2a17-0540-479b-96ea-61acffbfef54,host='devstack@QuobyteHD#QuobyteHD',id=5a057e30-6911-4c33-8cb7-4ec00dc57670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93dfd2784ca40ab9ca8f5b35e058ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:29Z,use_quota=True,user_id='a271702d20e3456ea36cf99343bb439f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f457043-76ca-4b5e-829b-05bfdb623dd1),volume_type_id=0f457043-76ca-4b5e-829b-05bfdb623dd1)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622ab139-bf45-4e5f-8ec1-81219e98d7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622ab139-bf45-4e5f-8ec1-81219e98d7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fb29c7-d1a4-4c08-b179-a5b5c166bb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3fb29c7-d1a4-4c08-b179-a5b5c166bb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a057e30-6911-4c33-8cb7-4ec00dc57670', 'volume_name': 'volume-5a057e30-6911-4c33-8cb7-4ec00dc57670', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4889f7b3-045a-4853-9e5d-849080ce0d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4889f7b3-045a-4853-9e5d-849080ce0d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d440c107-3904-4633-84a9-cf77eece6443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:29 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Volume 5a057e30-6911-4c33-8cb7-4ec00dc57670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a057e30-6911-4c33-8cb7-4ec00dc57670', 'volume_size': 1} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2b1f2a17-0540-479b-96ea-61acffbfef54,created_at=2026-07-07T15:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-539830235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2b1f2a17-0540-479b-96ea-61acffbfef54,host='devstack@QuobyteHD#QuobyteHD',id=5a057e30-6911-4c33-8cb7-4ec00dc57670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93dfd2784ca40ab9ca8f5b35e058ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:29Z,use_quota=True,user_id='a271702d20e3456ea36cf99343bb439f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f457043-76ca-4b5e-829b-05bfdb623dd1),volume_type_id=0f457043-76ca-4b5e-829b-05bfdb623dd1)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Creating volume 5a057e30-6911-4c33-8cb7-4ec00dc57670 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:29 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:29 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 1073741824 Jul 07 17:55:29 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Acquiring lock "cinder-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Lock "cinder-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Acquiring lock "cinder-quobyte-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Lock "cinder-quobyte-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:30 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee52a8e3-3b92-4d5d-a6ce-1db810228147]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:30 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 Jul 07 17:55:30 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "cinder-quobyte-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:30 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed4dafe-3442-4874-bfca-40977d936353]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:30 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 Jul 07 17:55:30 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:30 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 1073741824" returned: 0 in 1.301s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:31 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 Jul 07 17:55:31 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:31 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65" returned: 0 in 1.559s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:31 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65 Jul 07 17:55:31 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:31 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" returned: 0 in 1.474s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:31 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46 Jul 07 17:55:31 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:31 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670" returned: 0 in 0.941s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] <== create_volume: return (2363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.366s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d440c107-3904-4633-84a9-cf77eece6443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a057e30-6911-4c33-8cb7-4ec00dc57670', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0153a332-3576-4fe7-bd13-28dea8a03d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:32 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Volume volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 (5a057e30-6911-4c33-8cb7-4ec00dc57670): created successfully Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0153a332-3576-4fe7-bd13-28dea8a03d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Flow 'volume_create_manager' (8739f310-f5dc-4824-ba5b-354a19df086e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:32 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4a5f9b07-b6dc-45c6-8a22-bab2b380d3d2 tempest-GroupSnapshotsV319Test-836594397 None] Created volume successfully. Jul 07 17:55:32 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65" returned: 0 in 0.936s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Lock "cinder-quobyte-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65" released by "delete_volume" :: held 2.562s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:32 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" returned: 0 in 0.836s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Lock "cinder-quobyte-2ef9f274-2b5e-468a-b6c3-01a6fbc45a46" released by "delete_volume" :: held 2.383s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Created reservations ['16609aae-fb8e-4884-8b7e-1861d1b02c21', '9bd8b824-44f4-40d7-b02b-2612016e8b81', '0f02b5a5-ea54-4c7d-9849-1d5508ba76da', '784fca06-8e73-41e1-8fc1-7072948156da'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['7c7aa5f3-7a70-4922-8a30-fbf6b870bea6'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:32 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:32 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:32 devstack cinder-volume[87228]: WARNING cinder.quota [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-272569727 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-272569727, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Created reservations ['62497411-91a4-41fb-b15c-1131717f8486', '550afb72-b5f6-451e-ba12-8ccd77552f6f', '495eb41e-da35-436d-a574-58ea187b63e0', 'e4658a35-f991-45b3-96a3-cbcc76a4893a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:32 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:32 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:33 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.749s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Deleted volume successfully. Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac91d456-582b-45ac-a3b6-40515e96ea55 tempest-VolumesMetadataTest-1273353306 None] Lock "cinder-a5e654b4-7992-46a7-8d2c-b8d60b8a2d65-delete_volume" released by "delete_volume" :: held 3.636s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:33 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.823s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] GroupSnapshot e64a978e-b8a4-452f-a039-e07cfec0ef86: creating. Jul 07 17:55:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4c254ff4-9f99-4bdf-a415-4e165d864022 tempest-GroupSnapshotsTest-1654924055 None] Delete group completed successfully. Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Group snapshot e64a978e-b8a4-452f-a039-e07cfec0ef86: creating. {{(pid=87228) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Creating offline snapshot 0a423b46-da9b-49eb-9426-855b8c54fdaf of volume 5a057e30-6911-4c33-8cb7-4ec00dc57670 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e52877-c1a7-4649-a036-56fe9fbd129c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:33 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 Jul 07 17:55:33 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:35 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670" returned: 0 in 1.339s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:35 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf 1G Jul 07 17:55:35 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:36 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf 1G" returned: 0 in 1.480s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:36 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf Jul 07 17:55:36 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:37 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf" returned: 0 in 1.154s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:37 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:55:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:37 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf Jul 07 17:55:37 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:38 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf" returned: 0 in 1.102s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:39 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.info Jul 07 17:55:39 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:40 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.info" returned: 0 in 1.060s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:40 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:55:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:40 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.info Jul 07 17:55:40 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:40 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.info" returned: 0 in 0.869s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.135s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6931f15c-1cb5-4bdc-8916-0e9e2e083075 tempest-GroupSnapshotsV319Test-836594397 None] group_snapshot e64a978e-b8a4-452f-a039-e07cfec0ef86: created successfully Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Flow 'volume_create_manager' (30c8794a-e8a1-4595-9e28-4f8b60ffe489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fca1fd-209e-4dd3-90e6-385c8c7c224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fca1fd-209e-4dd3-90e6-385c8c7c224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1377715084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427135f1-d08f-49e5-9ffc-a954d819904f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526f435cdcd346a98d5f67924d6f0bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:41Z,use_quota=True,user_id='60d0ce38734c4879b7032d3caf0ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94e079f-f617-4983-ab6f-26daf9996e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94e079f-f617-4983-ab6f-26daf9996e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37101162-0c3c-41c1-b90c-1418e4e67a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37101162-0c3c-41c1-b90c-1418e4e67a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '427135f1-d08f-49e5-9ffc-a954d819904f', 'volume_name': 'volume-427135f1-d08f-49e5-9ffc-a954d819904f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0e26c9-c218-4c57-9181-df579ba5cb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de0e26c9-c218-4c57-9181-df579ba5cb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1233cdb8-3a9b-4abb-8297-e045dfbc8d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:41 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Volume 427135f1-d08f-49e5-9ffc-a954d819904f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-427135f1-d08f-49e5-9ffc-a954d819904f', 'volume_size': 1} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1377715084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=427135f1-d08f-49e5-9ffc-a954d819904f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526f435cdcd346a98d5f67924d6f0bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:41Z,use_quota=True,user_id='60d0ce38734c4879b7032d3caf0ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Creating volume 427135f1-d08f-49e5-9ffc-a954d819904f {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:41 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:41 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f 1073741824 Jul 07 17:55:41 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] group_snapshot e64a978e-b8a4-452f-a039-e07cfec0ef86: deleting Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] group_snapshot e64a978e-b8a4-452f-a039-e07cfec0ef86: deleting {{(pid=87228) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Acquiring lock "cinder-quobyte-5a057e30-6911-4c33-8cb7-4ec00dc57670" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Lock "cinder-quobyte-5a057e30-6911-4c33-8cb7-4ec00dc57670" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Acquiring lock "cinder-quobyte-0a423b46-da9b-49eb-9426-855b8c54fdaf" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Lock "cinder-quobyte-0a423b46-da9b-49eb-9426-855b8c54fdaf" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Deleting offline snapshot 0a423b46-da9b-49eb-9426-855b8c54fdaf of volume 5a057e30-6911-4c33-8cb7-4ec00dc57670 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] snapshot_file for this snap is: volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9940c06e-d01d-4498-b2d3-09ab540fc93c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b0964a87-f699-42a6-a03e-e0151fa17c57 tempest-GroupsTest-128142587 None] Group tempest-Group1-1139221364: creating Jul 07 17:55:42 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf Jul 07 17:55:42 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b0964a87-f699-42a6-a03e-e0151fa17c57 tempest-GroupsTest-128142587 None] Group tempest-Group1-1139221364: created successfully Jul 07 17:55:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b0964a87-f699-42a6-a03e-e0151fa17c57 tempest-GroupsTest-128142587 None] Create group completed successfully. Jul 07 17:55:42 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f 1073741824" returned: 0 in 1.283s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:42 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f Jul 07 17:55:42 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:43 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf" returned: 0 in 0.973s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a057e30-6911-4c33-8cb7-4ec00dc57670(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7ec93f-0f25-4a16-98a7-640177bd3f47]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:43 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f" returned: 0 in 0.712s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1233cdb8-3a9b-4abb-8297-e045dfbc8d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-427135f1-d08f-49e5-9ffc-a954d819904f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b74a76-5a17-4a45-931b-2ce28937189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:43 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 Jul 07 17:55:43 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:43 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Volume volume-427135f1-d08f-49e5-9ffc-a954d819904f (427135f1-d08f-49e5-9ffc-a954d819904f): created successfully Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b74a76-5a17-4a45-931b-2ce28937189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Flow 'volume_create_manager' (30c8794a-e8a1-4595-9e28-4f8b60ffe489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-00328656-99cd-46cb-b969-7e3e201a81fb tempest-VolumesTransfersTest-1283926178 None] Created volume successfully. Jul 07 17:55:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4035afa4-8393-4017-914e-6a4af1ff6cc0 tempest-GroupsTest-128142587 None] Group tempest-Group2-2077923065: creating Jul 07 17:55:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4035afa4-8393-4017-914e-6a4af1ff6cc0 tempest-GroupsTest-128142587 None] Group tempest-Group2-2077923065: created successfully Jul 07 17:55:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4035afa4-8393-4017-914e-6a4af1ff6cc0 tempest-GroupsTest-128142587 None] Create group completed successfully. Jul 07 17:55:44 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670" returned: 0 in 0.899s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:44 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf Jul 07 17:55:44 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5f6e64d9-d3e7-4827-b4a6-f83c1561e5c9 tempest-VolumesTransfersTest-669918937 None] Transfer volume completed successfully. Jul 07 17:55:44 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf" returned: 0 in 0.896s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:45 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf Jul 07 17:55:45 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Flow 'volume_create_manager' (55892fae-b090-41e1-8d36-a54e71c6f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e9f3dd-8cff-4cf8-ba22-7dec419da082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e9f3dd-8cff-4cf8-ba22-7dec419da082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945105814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f077231-b152-46ec-8190-176e09169278,host='devstack@QuobyteHD#QuobyteHD',id=093be50d-b120-432e-a158-86a1d1d85fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6952e68df20a4ebe8001bad3a2f84165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:46Z,use_quota=True,user_id='0ae087ab549447aabd84be66fe0e48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c86511a-994f-4e3c-978d-a44fe2dd2984),volume_type_id=7c86511a-994f-4e3c-978d-a44fe2dd2984)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b724942-6197-4c28-a110-4c6c66897ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b724942-6197-4c28-a110-4c6c66897ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f843304-66e0-484e-bb04-edd149573c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f843304-66e0-484e-bb04-edd149573c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093be50d-b120-432e-a158-86a1d1d85fb4', 'volume_name': 'volume-093be50d-b120-432e-a158-86a1d1d85fb4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1624f2-b833-490b-9dee-529eaa5bbb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd1624f2-b833-490b-9dee-529eaa5bbb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559c730-c431-4d7a-8e6e-0c9b6e351c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:45 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Volume 093be50d-b120-432e-a158-86a1d1d85fb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093be50d-b120-432e-a158-86a1d1d85fb4', 'volume_size': 1} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8f077231-b152-46ec-8190-176e09169278,created_at=2026-07-07T15:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945105814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8f077231-b152-46ec-8190-176e09169278,host='devstack@QuobyteHD#QuobyteHD',id=093be50d-b120-432e-a158-86a1d1d85fb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6952e68df20a4ebe8001bad3a2f84165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:46Z,use_quota=True,user_id='0ae087ab549447aabd84be66fe0e48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c86511a-994f-4e3c-978d-a44fe2dd2984),volume_type_id=7c86511a-994f-4e3c-978d-a44fe2dd2984)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Creating volume 093be50d-b120-432e-a158-86a1d1d85fb4 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:45 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:45 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 1073741824 Jul 07 17:55:45 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Acquiring lock "cinder-427135f1-d08f-49e5-9ffc-a954d819904f-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Lock "cinder-427135f1-d08f-49e5-9ffc-a954d819904f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:45 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Acquiring lock "cinder-quobyte-427135f1-d08f-49e5-9ffc-a954d819904f" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670.0a423b46-da9b-49eb-9426-855b8c54fdaf" returned: 0 in 1.031s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Lock "cinder-quobyte-427135f1-d08f-49e5-9ffc-a954d819904f" acquired by "delete_volume" :: waited 0.051s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Lock "cinder-quobyte-0a423b46-da9b-49eb-9426-855b8c54fdaf" released by "_delete_snapshot" :: held 3.943s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Lock "cinder-quobyte-5a057e30-6911-4c33-8cb7-4ec00dc57670" released by "delete_snapshot" :: held 3.984s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[852444e9-e24a-42fd-a027-312e9875f0b9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:46 devstack cinder-volume[87228]: WARNING cinder.quota [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-450612521 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-450612521, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:46 devstack cinder-volume[87228]: WARNING cinder.quota [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-450612521 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-450612521, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:46 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] Created reservations ['c0abb462-45ed-43c1-a3a4-94d733eebb01', '4ac702df-480b-42bb-a3aa-011435f988af', 'ff43d489-373c-44cd-a29b-df1342e78b3e', 'a463d3cf-ae1c-4b96-8b30-010c32bf29d5'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:46 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-701c1617-6b81-47a1-9166-66ca62c660ba tempest-GroupSnapshotsV319Test-836594397 None] group_snapshot e64a978e-b8a4-452f-a039-e07cfec0ef86: deleted successfully Jul 07 17:55:46 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f Jul 07 17:55:46 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:47 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 1073741824" returned: 0 in 1.239s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:47 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f" returned: 0 in 0.989s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:47 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f Jul 07 17:55:47 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:47 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 Jul 07 17:55:47 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Acquiring lock "cinder-quobyte-5a057e30-6911-4c33-8cb7-4ec00dc57670" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Lock "cinder-quobyte-5a057e30-6911-4c33-8cb7-4ec00dc57670" acquired by "delete_volume" :: waited 0.047s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf1b921-de0c-4d06-a141-6660df8d0f24]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:47 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 Jul 07 17:55:47 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:47 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-427135f1-d08f-49e5-9ffc-a954d819904f" returned: 0 in 0.786s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Lock "cinder-quobyte-427135f1-d08f-49e5-9ffc-a954d819904f" released by "delete_volume" :: held 1.840s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:47 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Created reservations ['6e896f2a-9142-4629-be89-60513b747cbe', '74ce0d8a-aae2-4998-835c-4e61301941cb', '8efb28a3-749b-4e1b-b618-0d15d7524b7d', 'fc3694cf-5faa-4852-9d6d-7c1a270c64aa'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:48 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4" returned: 0 in 0.920s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8559c730-c431-4d7a-8e6e-0c9b6e351c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093be50d-b120-432e-a158-86a1d1d85fb4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e5d4cc-2da3-4c00-a5b2-ec4564f0c336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:48 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Volume volume-093be50d-b120-432e-a158-86a1d1d85fb4 (093be50d-b120-432e-a158-86a1d1d85fb4): created successfully Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e5d4cc-2da3-4c00-a5b2-ec4564f0c336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Flow 'volume_create_manager' (55892fae-b090-41e1-8d36-a54e71c6f211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-fc3f3ed3-75d9-4f4d-bb30-6bc41531810b tempest-GroupsTest-128142587 None] Created volume successfully. Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:48 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:48 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:48 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670" returned: 0 in 1.106s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:48 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670 Jul 07 17:55:48 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:49 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.886s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Deleted volume successfully. Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9849f77f-2ed5-4702-a8f5-6f793618ff9a tempest-VolumesTransfersTest-687431134 None] Lock "cinder-427135f1-d08f-49e5-9ffc-a954d819904f-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Flow 'volume_create_manager' (58bd4458-d50f-4f0f-9e0c-633c7adf88d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c616f507-1bc3-4576-82b8-1f1265ac28a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c616f507-1bc3-4576-82b8-1f1265ac28a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1984283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526f435cdcd346a98d5f67924d6f0bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:49Z,use_quota=True,user_id='60d0ce38734c4879b7032d3caf0ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60048722-52c2-401e-8815-868eb0821933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60048722-52c2-401e-8815-868eb0821933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35d3f04-e8d8-466f-808b-3a111397344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35d3f04-e8d8-466f-808b-3a111397344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6', 'volume_name': 'volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed722e8-8216-4ba5-bb09-01e09bf7db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed722e8-8216-4ba5-bb09-01e09bf7db55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a9abdf-5a1c-4cd0-9566-26a9435833d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:49 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Volume 4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6', 'volume_size': 1} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1984283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526f435cdcd346a98d5f67924d6f0bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:49Z,use_quota=True,user_id='60d0ce38734c4879b7032d3caf0ad635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Creating volume 4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:49 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:49 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 1073741824 Jul 07 17:55:49 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:49 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5a057e30-6911-4c33-8cb7-4ec00dc57670" returned: 0 in 0.935s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Lock "cinder-quobyte-5a057e30-6911-4c33-8cb7-4ec00dc57670" released by "delete_volume" :: held 2.154s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Created reservations ['44da87f3-8e81-432b-8e1a-2c1d647a7697'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:49 devstack cinder-volume[87228]: WARNING cinder.quota [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-450612521 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-450612521, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Created reservations ['f007b892-e44b-426f-bc30-14c798ce260c', '6eff256e-7499-4d43-8563-d249dcb3b128', 'deaa76b2-1dd8-4200-9b5a-72fbfd5015e3', 'a224742e-fa65-4607-aea2-237aafc65810'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:49 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:49 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Acquiring lock "cinder-quobyte-093be50d-b120-432e-a158-86a1d1d85fb4" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Lock "cinder-quobyte-093be50d-b120-432e-a158-86a1d1d85fb4" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:50 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb82232-951a-4647-a191-d5ec90f8e488]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:50 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 1073741824" returned: 0 in 1.116s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:50 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 Jul 07 17:55:50 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:50 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 Jul 07 17:55:50 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:50 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.795s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:50 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-46cc2da1-e2cb-4451-aa66-563d79eb365d tempest-GroupSnapshotsV319Test-836594397 None] Delete group completed successfully. Jul 07 17:55:51 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4" returned: 0 in 0.843s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:51 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4 Jul 07 17:55:51 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:51 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6" returned: 0 in 0.762s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a9abdf-5a1c-4cd0-9566-26a9435833d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb94e1cb-fa7d-41be-b685-a659f1b57a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:51 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Volume volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 (4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6): created successfully Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb94e1cb-fa7d-41be-b685-a659f1b57a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Flow 'volume_create_manager' (58bd4458-d50f-4f0f-9e0c-633c7adf88d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8b72350e-3499-4bae-ba56-080818196ece tempest-VolumesTransfersTest-1283926178 None] Created volume successfully. Jul 07 17:55:51 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-093be50d-b120-432e-a158-86a1d1d85fb4" returned: 0 in 0.732s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Lock "cinder-quobyte-093be50d-b120-432e-a158-86a1d1d85fb4" released by "delete_volume" :: held 1.634s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Created reservations ['04852839-83e9-4ad2-ac2c-f576ad89bffc'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:52 devstack cinder-volume[87228]: WARNING cinder.quota [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-853695654 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-853695654, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:52 devstack cinder-volume[87228]: WARNING cinder.quota [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-853695654 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-853695654, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Created reservations ['8c853070-3038-42ce-a861-3a31d5f99f08', '105b290e-a114-41c4-9dc6-67225bf38d05', '7c3044c8-a7ca-4948-9e39-237b960950b8', '287d1c8e-40f4-44f5-ad63-9203cac061cd'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:52 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:52 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Acquiring lock "cinder-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Lock "cinder-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Acquiring lock "cinder-quobyte-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Lock "cinder-quobyte-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6" acquired by "delete_volume" :: waited 0.049s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ea6e80-b05d-4f3b-935b-82bb21541f80]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Created reservations ['419e820b-f244-4285-a215-ba109cfb7b4b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:52 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 Jul 07 17:55:52 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:52 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:52 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:53 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.845s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:53 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b12b1250-4813-439a-9a05-6f32a3b609a6 tempest-GroupsTest-128142587 None] Delete group completed successfully. Jul 07 17:55:53 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.712s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:53 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-03fd02ff-db2c-483d-92cc-063924a86471 tempest-GroupsTest-128142587 None] Delete group completed successfully. Jul 07 17:55:53 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6" returned: 0 in 0.946s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:53 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6 Jul 07 17:55:53 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6c71fd07-f2dd-4776-8143-6542e9dd0f9f tempest-GroupsTest-128142587 None] Group tempest-GroupsTest-Group-1143751044: creating Jul 07 17:55:54 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6" returned: 0 in 0.803s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Lock "cinder-quobyte-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6" released by "delete_volume" :: held 1.827s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6c71fd07-f2dd-4776-8143-6542e9dd0f9f tempest-GroupsTest-128142587 None] Group tempest-GroupsTest-Group-1143751044: created successfully Jul 07 17:55:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6c71fd07-f2dd-4776-8143-6542e9dd0f9f tempest-GroupsTest-128142587 None] Create group completed successfully. Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Created reservations ['184f8c53-6b1c-43c4-aa11-9eedc8adc609', 'cb9b33a6-addb-49a8-b1f8-07a09e9194c1', '08bd3ef1-9a10-42c3-9e0c-be4ef763ad39', 'f83bb91b-1281-43b4-a498-a9548557b60c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:54 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:55:54 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:55 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.768s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:55 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Deleted volume successfully. Jul 07 17:55:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b3f964c6-cd50-448e-a899-dd7bae4d9b25 tempest-VolumesTransfersTest-687431134 None] Lock "cinder-4ba7f420-8b82-4e2b-b7c4-4c40c0b58bd6-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Flow 'volume_create_manager' (2dc741fa-6e19-497c-8c78-83d167865e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c50545-257b-4319-9f2c-0c7009822cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c50545-257b-4319-9f2c-0c7009822cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2016879166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8080702a-55aa-468f-b1fd-3ecb86dd0e37,host='devstack@QuobyteHD#QuobyteHD',id=5957a629-b851-425b-abde-11b6847f4495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6952e68df20a4ebe8001bad3a2f84165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:56Z,use_quota=True,user_id='0ae087ab549447aabd84be66fe0e48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adc61431-dd31-450b-bc5d-6d0a7178a455),volume_type_id=adc61431-dd31-450b-bc5d-6d0a7178a455)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ab43a-2e13-44ba-b21b-2fb9cab842b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ab43a-2e13-44ba-b21b-2fb9cab842b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7281a9-e96d-41ff-a50a-9ef25ef0c12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7281a9-e96d-41ff-a50a-9ef25ef0c12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5957a629-b851-425b-abde-11b6847f4495', 'volume_name': 'volume-5957a629-b851-425b-abde-11b6847f4495', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bce419-ca0b-4179-8063-42611a68965f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bce419-ca0b-4179-8063-42611a68965f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c0638f-6fa1-417f-b6bc-34022094c058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:56 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Volume 5957a629-b851-425b-abde-11b6847f4495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5957a629-b851-425b-abde-11b6847f4495', 'volume_size': 1} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8080702a-55aa-468f-b1fd-3ecb86dd0e37,created_at=2026-07-07T15:55:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2016879166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8080702a-55aa-468f-b1fd-3ecb86dd0e37,host='devstack@QuobyteHD#QuobyteHD',id=5957a629-b851-425b-abde-11b6847f4495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6952e68df20a4ebe8001bad3a2f84165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:56Z,use_quota=True,user_id='0ae087ab549447aabd84be66fe0e48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adc61431-dd31-450b-bc5d-6d0a7178a455),volume_type_id=adc61431-dd31-450b-bc5d-6d0a7178a455)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Creating volume 5957a629-b851-425b-abde-11b6847f4495 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:56 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:56 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 1073741824 Jul 07 17:55:56 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:57 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 1073741824" returned: 0 in 1.232s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:57 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 Jul 07 17:55:57 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:58 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495" returned: 0 in 0.718s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:55:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c0638f-6fa1-417f-b6bc-34022094c058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5957a629-b851-425b-abde-11b6847f4495', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634197c7-ac76-4f9b-ae01-5750e1b594a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:58 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Volume volume-5957a629-b851-425b-abde-11b6847f4495 (5957a629-b851-425b-abde-11b6847f4495): created successfully Jul 07 17:55:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634197c7-ac76-4f9b-ae01-5750e1b594a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Flow 'volume_create_manager' (2dc741fa-6e19-497c-8c78-83d167865e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7907144b-9651-4f96-9b23-21199acad1ce tempest-GroupsTest-128142587 None] Created volume successfully. Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Flow 'volume_create_manager' (0ace4781-6a07-4675-9a6e-6aeefd4910b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39efe056-3d6d-4400-b67d-9c9ee3a89e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39efe056-3d6d-4400-b67d-9c9ee3a89e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938513014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8080702a-55aa-468f-b1fd-3ecb86dd0e37,host='devstack@QuobyteHD#QuobyteHD',id=e65d8f82-ba63-415d-b4bb-a5172a36475c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6952e68df20a4ebe8001bad3a2f84165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:59Z,use_quota=True,user_id='0ae087ab549447aabd84be66fe0e48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adc61431-dd31-450b-bc5d-6d0a7178a455),volume_type_id=adc61431-dd31-450b-bc5d-6d0a7178a455)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee29feb9-416a-4a3a-b3a2-59e3b4abb303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee29feb9-416a-4a3a-b3a2-59e3b4abb303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da12fe69-2cae-4ba2-ad44-2df338b95fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da12fe69-2cae-4ba2-ad44-2df338b95fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65d8f82-ba63-415d-b4bb-a5172a36475c', 'volume_name': 'volume-e65d8f82-ba63-415d-b4bb-a5172a36475c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4e2b86-176a-460a-97ad-6dd65129d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4e2b86-176a-460a-97ad-6dd65129d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83ce283-5601-4e74-820f-48eac58f4eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:55:59 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Volume e65d8f82-ba63-415d-b4bb-a5172a36475c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65d8f82-ba63-415d-b4bb-a5172a36475c', 'volume_size': 1} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8080702a-55aa-468f-b1fd-3ecb86dd0e37,created_at=2026-07-07T15:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938513014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8080702a-55aa-468f-b1fd-3ecb86dd0e37,host='devstack@QuobyteHD#QuobyteHD',id=e65d8f82-ba63-415d-b4bb-a5172a36475c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6952e68df20a4ebe8001bad3a2f84165',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:55:59Z,use_quota=True,user_id='0ae087ab549447aabd84be66fe0e48be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adc61431-dd31-450b-bc5d-6d0a7178a455),volume_type_id=adc61431-dd31-450b-bc5d-6d0a7178a455)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Creating volume e65d8f82-ba63-415d-b4bb-a5172a36475c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:55:59 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:55:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:59 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c 1073741824 Jul 07 17:55:59 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:00 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c 1073741824" returned: 0 in 1.142s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:00 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c Jul 07 17:56:00 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:01 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-90e46662-f474-4689-9d23-7a155fa28f88 req-013e6321-0974-466b-83e9-5c0fdbc91a6c tempest-AttachVolumeTestJSON-357092893 None] Terminate volume connection completed successfully. Jul 07 17:56:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-90e46662-f474-4689-9d23-7a155fa28f88 req-013e6321-0974-466b-83e9-5c0fdbc91a6c tempest-AttachVolumeTestJSON-357092893 None] Deleting attachment 10c3eadd-61aa-4738-a23e-b835d8d3bd66. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:56:01 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c" returned: 0 in 0.781s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:56:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83ce283-5601-4e74-820f-48eac58f4eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65d8f82-ba63-415d-b4bb-a5172a36475c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56832cec-05e8-4630-8b36-c36958b8ac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:01 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Volume volume-e65d8f82-ba63-415d-b4bb-a5172a36475c (e65d8f82-ba63-415d-b4bb-a5172a36475c): created successfully Jul 07 17:56:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56832cec-05e8-4630-8b36-c36958b8ac58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Flow 'volume_create_manager' (0ace4781-6a07-4675-9a6e-6aeefd4910b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:01 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b9653fe1-497d-4e86-ab7a-81016192561c tempest-GroupsTest-128142587 None] Created volume successfully. Jul 07 17:56:02 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ff90a57c-1155-48b6-a870-9b314d1a557a tempest-GroupsTest-128142587 None] Update group completed successfully. Jul 07 17:56:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3a6d31f7-e659-4cd3-b8e6-3c78f1532878 tempest-GroupsTest-128142587 None] Update group completed successfully. Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Flow 'volume_create_manager' (6aa56fd1-9dc4-44a4-ba58-ac2a2fefc2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145c6d28-ddc6-4c3a-9aad-18102f1503f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145c6d28-ddc6-4c3a-9aad-18102f1503f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1270127726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cb8eba-fe0f-4443-a5c6-f4a09777e426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b08436d24c4104bcc1802366e41ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:04Z,use_quota=True,user_id='fede98b35eba46a494fbe0d0fcd88974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f528be-183b-40f0-9f96-c00c292c6268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f528be-183b-40f0-9f96-c00c292c6268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52722374-7b53-4b8b-a2f0-cacb55cd8edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52722374-7b53-4b8b-a2f0-cacb55cd8edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9cb8eba-fe0f-4443-a5c6-f4a09777e426', 'volume_name': 'volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae48131-0dc3-43ad-b2ee-b01d8e66db5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae48131-0dc3-43ad-b2ee-b01d8e66db5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86bc7ac-1c67-4377-879a-b4df95aa664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:03 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Volume a9cb8eba-fe0f-4443-a5c6-f4a09777e426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426', 'volume_size': 1} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1270127726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9cb8eba-fe0f-4443-a5c6-f4a09777e426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b08436d24c4104bcc1802366e41ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:04Z,use_quota=True,user_id='fede98b35eba46a494fbe0d0fcd88974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Creating volume a9cb8eba-fe0f-4443-a5c6-f4a09777e426 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:56:03 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:56:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:03 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 1073741824 Jul 07 17:56:03 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c14d5edc-c15e-4c83-a8df-4657482e910c tempest-GroupsV314Test-1587869617 None] Group tempest-GroupsV314Test-Group-1816143745: creating Jul 07 17:56:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c14d5edc-c15e-4c83-a8df-4657482e910c tempest-GroupsV314Test-1587869617 None] Group tempest-GroupsV314Test-Group-1816143745: created successfully Jul 07 17:56:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c14d5edc-c15e-4c83-a8df-4657482e910c tempest-GroupsV314Test-1587869617 None] Create group completed successfully. Jul 07 17:56:04 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 1073741824" returned: 0 in 0.919s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:04 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 Jul 07 17:56:04 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Acquiring lock "cinder-quobyte-5957a629-b851-425b-abde-11b6847f4495" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Lock "cinder-quobyte-5957a629-b851-425b-abde-11b6847f4495" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a07a723-147a-4166-9446-ce5cc4680e23]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:05 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 Jul 07 17:56:05 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:05 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426" returned: 0 in 0.780s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86bc7ac-1c67-4377-879a-b4df95aa664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91748e0-72ef-4bb4-9e62-c0ffdb61db01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:05 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Volume volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 (a9cb8eba-fe0f-4443-a5c6-f4a09777e426): created successfully Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b91748e0-72ef-4bb4-9e62-c0ffdb61db01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Flow 'volume_create_manager' (6aa56fd1-9dc4-44a4-ba58-ac2a2fefc2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:05 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-76d85de1-d4b2-4f12-98f0-3ef1e8aeed14 tempest-VolumesTransfersV355Test-913127450 None] Created volume successfully. Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Flow 'volume_create_manager' (005ba700-c932-455f-92d6-60d0bb345b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaf84cf-df40-409c-9c69-8734d780ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eaf84cf-df40-409c-9c69-8734d780ca41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-484037608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25c396fd-214e-42a9-bb5d-1286e58f6888,host='devstack@QuobyteHD#QuobyteHD',id=10682f74-70c0-4f7b-9e98-d05c2469dc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa3523c74264615a3fedd29c620e8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:06Z,use_quota=True,user_id='0386903f38f34dcdba0228c7695f2f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7d9ac5f-506c-400a-aa28-0570832237a6),volume_type_id=d7d9ac5f-506c-400a-aa28-0570832237a6)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfccb03d-dbfa-466f-b621-0153509a3db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfccb03d-dbfa-466f-b621-0153509a3db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45f6b86-92be-4b00-80e8-8bab04e3904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45f6b86-92be-4b00-80e8-8bab04e3904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10682f74-70c0-4f7b-9e98-d05c2469dc6b', 'volume_name': 'volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46707216-9caf-41b7-9f1f-692f6624d266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46707216-9caf-41b7-9f1f-692f6624d266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c19b49-2659-45ff-abf2-b6a3e53cca6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:06 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Volume 10682f74-70c0-4f7b-9e98-d05c2469dc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b', 'volume_size': 1} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=25c396fd-214e-42a9-bb5d-1286e58f6888,created_at=2026-07-07T15:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-484037608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=25c396fd-214e-42a9-bb5d-1286e58f6888,host='devstack@QuobyteHD#QuobyteHD',id=10682f74-70c0-4f7b-9e98-d05c2469dc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaa3523c74264615a3fedd29c620e8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:06Z,use_quota=True,user_id='0386903f38f34dcdba0228c7695f2f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7d9ac5f-506c-400a-aa28-0570832237a6),volume_type_id=d7d9ac5f-506c-400a-aa28-0570832237a6)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Creating volume 10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:56:06 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:06 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b 1073741824 Jul 07 17:56:06 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:06 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495" returned: 0 in 0.888s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:06 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495 Jul 07 17:56:06 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:INSERT=41,cinder:UPDATE=175,cinder:DELETE=9,cinder:SELECT=167 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:56:06 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-091f24db-3de3-4429-b136-f389e25047d9 tempest-VolumesTransfersV355Test-1294408279 None] Transfer volume completed successfully. Jul 07 17:56:06 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5957a629-b851-425b-abde-11b6847f4495" returned: 0 in 0.705s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Lock "cinder-quobyte-5957a629-b851-425b-abde-11b6847f4495" released by "delete_volume" :: held 1.665s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Acquiring lock "cinder-quobyte-e65d8f82-ba63-415d-b4bb-a5172a36475c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Lock "cinder-quobyte-e65d8f82-ba63-415d-b4bb-a5172a36475c" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:06 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b 1073741824" returned: 0 in 0.949s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[338d78a0-7ffb-418f-b4bc-6a0377409f85]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=176,cinder:SELECT=153,cinder:INSERT=39,cinder:DELETE=10 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:07 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b Jul 07 17:56:07 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:07 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c Jul 07 17:56:07 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Acquiring lock "cinder-a9cb8eba-fe0f-4443-a5c6-f4a09777e426-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Lock "cinder-a9cb8eba-fe0f-4443-a5c6-f4a09777e426-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Acquiring lock "cinder-quobyte-a9cb8eba-fe0f-4443-a5c6-f4a09777e426" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Lock "cinder-quobyte-a9cb8eba-fe0f-4443-a5c6-f4a09777e426" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[88521283-83ab-4031-90aa-94ca0145f2e9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:07 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b" returned: 0 in 0.876s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:07 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c" returned: 0 in 0.970s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:07 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 Jul 07 17:56:07 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c19b49-2659-45ff-abf2-b6a3e53cca6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfba4743-8c5a-4030-9cd3-eb8986c65974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:07 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c Jul 07 17:56:07 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:07 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Volume volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b (10682f74-70c0-4f7b-9e98-d05c2469dc6b): created successfully Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfba4743-8c5a-4030-9cd3-eb8986c65974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Flow 'volume_create_manager' (005ba700-c932-455f-92d6-60d0bb345b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-30ebff4e-d1b2-4da7-b4e5-8a2069fe41bf tempest-GroupsV314Test-1587869617 None] Created volume successfully. Jul 07 17:56:08 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426" returned: 0 in 0.867s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:08 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e65d8f82-ba63-415d-b4bb-a5172a36475c" returned: 0 in 0.716s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:08 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426 Jul 07 17:56:08 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Lock "cinder-quobyte-e65d8f82-ba63-415d-b4bb-a5172a36475c" released by "delete_volume" :: held 1.745s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Created reservations ['6f550cb0-14d9-444e-8753-81809292c8de'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:08 devstack cinder-volume[87228]: WARNING cinder.quota [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1438745035 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1438745035, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:56:08 devstack cinder-volume[87228]: WARNING cinder.quota [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1438745035 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1438745035, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Created reservations ['38013ab5-a3df-4d10-8b85-a499ebd99466', '2d41b16c-7a36-4a24-a725-67dce93bad85', '3e15ec16-feda-401f-99c2-cc5d5708dd9a', 'ce3b3c2e-e942-427d-b2fb-6a7d9871ad74'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:08 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Created reservations ['9b13fae8-544d-461c-b29f-a54d40463fd2', '1053fd06-9d89-40aa-87c2-ce2e19ca7c8e', '70e5b1e2-487f-4503-8a11-f7e3753c5abc', '41ca316d-c280-4c2a-ac13-21b8a47b56e2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:09 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:56:09 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:09 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9cb8eba-fe0f-4443-a5c6-f4a09777e426" returned: 0 in 0.730s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Lock "cinder-quobyte-a9cb8eba-fe0f-4443-a5c6-f4a09777e426" released by "delete_volume" :: held 1.674s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:09 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Cloning volume 10682f74-70c0-4f7b-9e98-d05c2469dc6b to volume 9dfd567f-6bfe-44ec-b184-e77929d94c33 Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Created reservations ['b847a77a-694a-4501-8b93-6ea46262f005', '6178e384-f414-4120-be87-5a3f67d25a3b', '281afd38-f791-4b2d-b240-bca8abdcd583', '16c19e3c-f5a4-4539-aa73-a87a1eb11951'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Creating offline snapshot 9b57e464-e7a8-4985-8fec-d49e99a12cee of volume 10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fdb518-1881-4fc9-be60-5f870d94b670]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:09 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:56:09 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:09 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b Jul 07 17:56:09 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:09 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.775s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:09 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:56:09 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d089fcc3-fd49-4552-a5a0-57958d2f2535 tempest-GroupsTest-128142587 None] Delete group completed successfully. Jul 07 17:56:10 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.816s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:56:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Deleted volume successfully. Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cea1a0f-f2b2-4cc4-8a52-da5b13369c92 tempest-VolumesTransfersV355Test-1058384372 None] Lock "cinder-a9cb8eba-fe0f-4443-a5c6-f4a09777e426-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Flow 'volume_create_manager' (b4339347-5738-416b-b4ee-9aa5e86d2d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2651ef62-612d-4e27-a82c-8e067665db7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2651ef62-612d-4e27-a82c-8e067665db7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-445240133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d65f74-933a-4144-a2f3-b97f35d157cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b08436d24c4104bcc1802366e41ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:10Z,use_quota=True,user_id='fede98b35eba46a494fbe0d0fcd88974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4999c82-6f34-42d1-8cfc-8c94eee1910b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4999c82-6f34-42d1-8cfc-8c94eee1910b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87abfc26-32b6-4afb-b9f3-66b228465daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87abfc26-32b6-4afb-b9f3-66b228465daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d65f74-933a-4144-a2f3-b97f35d157cf', 'volume_name': 'volume-a8d65f74-933a-4144-a2f3-b97f35d157cf', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17095802-19d2-4276-bb6c-99e89aa4fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17095802-19d2-4276-bb6c-99e89aa4fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:10 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab685b0d-70bc-4d03-a231-1da23d65b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:10 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Volume a8d65f74-933a-4144-a2f3-b97f35d157cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d65f74-933a-4144-a2f3-b97f35d157cf', 'volume_size': 1} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b" returned: 0 in 1.192s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:10 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee 1G Jul 07 17:56:10 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:11 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee 1G" returned: 0 in 0.983s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:11 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee Jul 07 17:56:11 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:12 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee" returned: 0 in 0.793s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:12 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:56:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:12 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee Jul 07 17:56:12 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:13 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee" returned: 0 in 0.714s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:13 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.info Jul 07 17:56:13 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:14 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.info" returned: 0 in 1.277s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:14 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:56:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:14 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.info Jul 07 17:56:14 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:15 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.info" returned: 0 in 0.872s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Acquiring lock "cinder-quobyte-9dfd567f-6bfe-44ec-b184-e77929d94c33" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Lock "cinder-quobyte-9dfd567f-6bfe-44ec-b184-e77929d94c33" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] snapshot: 9b57e464-e7a8-4985-8fec-d49e99a12cee, volume: 9dfd567f-6bfe-44ec-b184-e77929d94c33, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[01441b67-37cf-41e7-abd3-a0edb1a8fa06]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:15 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee Jul 07 17:56:15 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:16 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee" returned: 0 in 0.935s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:56:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:56:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:56:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a704c7c-30c6-487a-9ac9-0523dffcc915]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:16 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b Jul 07 17:56:16 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:17 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-db9ee0a7-7ea5-4f4b-86d0-d6df8dd4698b tempest-GroupsV320Test-1550836983 None] Group tempest-GroupsV320Test-Group-1188203304: creating Jul 07 17:56:17 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-db9ee0a7-7ea5-4f4b-86d0-d6df8dd4698b tempest-GroupsV320Test-1550836983 None] Group tempest-GroupsV320Test-Group-1188203304: created successfully Jul 07 17:56:17 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-db9ee0a7-7ea5-4f4b-86d0-d6df8dd4698b tempest-GroupsV320Test-1550836983 None] Create group completed successfully. Jul 07 17:56:17 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b" returned: 0 in 0.918s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:17 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:56:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:17 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 Jul 07 17:56:17 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:19 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Created reservations ['d2949e1c-07e1-4739-96f5-557feae6ba9c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:19 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:56:19 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:21 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.664s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:21 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:56:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-55f5ed3b-b7ff-4ed2-b8ce-e76bf43cea3c tempest-GroupsV320Test-1550836983 None] Delete group completed successfully. Jul 07 17:56:23 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33" returned: 0 in 6.140s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:23 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc04043a-b300-44a0-89ed-b28d2675f7ae]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:23 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b Jul 07 17:56:23 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:56:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 8 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:56:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:56:24 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b" returned: 0 in 1.066s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:24 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:56:24 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Converted 1024.00 MB image at 166.74 MB/s Jul 07 17:56:24 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 17:56:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:24 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 Jul 07 17:56:24 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:25 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33" returned: 0 in 0.812s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Lock "cinder-quobyte-9dfd567f-6bfe-44ec-b184-e77929d94c33" released by "_copy_volume_from_snapshot" :: held 9.973s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Acquiring lock "cinder-quobyte-9b57e464-e7a8-4985-8fec-d49e99a12cee" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Lock "cinder-quobyte-9b57e464-e7a8-4985-8fec-d49e99a12cee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Deleting offline snapshot 9b57e464-e7a8-4985-8fec-d49e99a12cee of volume 10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:56:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] snapshot_file for this snap is: volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:56:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b384f3a-2f43-4a6f-95bd-0395e5d93a42]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:25 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee Jul 07 17:56:25 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:26 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee" returned: 0 in 0.886s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:56:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9780d73f-9f5f-4d42-8155-9a57f73a5a59]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:26 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b Jul 07 17:56:26 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:27 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b" returned: 0 in 0.877s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:27 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee Jul 07 17:56:27 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:28 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee" returned: 0 in 0.867s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:28 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee Jul 07 17:56:28 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Flow 'volume_create_manager' (33968762-0fbd-4fc4-8603-f521006ba22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c8ff64-5967-4d37-a727-fe9d583c86d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c8ff64-5967-4d37-a727-fe9d583c86d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-481365127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec636e6-d44d-4515-9eef-f86dbe566348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6228e5b53df54720be6624de77d29e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:28Z,use_quota=True,user_id='0daa27979a344b189d749c8137fda392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abde0df-6f0e-4010-98b5-4117c778b6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abde0df-6f0e-4010-98b5-4117c778b6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8b78b0-c5af-4d6a-80af-3a88049af811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8b78b0-c5af-4d6a-80af-3a88049af811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec636e6-d44d-4515-9eef-f86dbe566348', 'volume_name': 'volume-0ec636e6-d44d-4515-9eef-f86dbe566348', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123d86bd-11cd-45cf-8cca-fc0b3b7fb6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123d86bd-11cd-45cf-8cca-fc0b3b7fb6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5966dd93-6956-4d08-93c6-69fded51013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:28 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Volume 0ec636e6-d44d-4515-9eef-f86dbe566348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec636e6-d44d-4515-9eef-f86dbe566348', 'volume_size': 1} Jul 07 17:56:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:29 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b.9b57e464-e7a8-4985-8fec-d49e99a12cee" returned: 0 in 0.809s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Lock "cinder-quobyte-9b57e464-e7a8-4985-8fec-d49e99a12cee" released by "_delete_snapshot" :: held 3.556s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.597s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.334s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-445240133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d65f74-933a-4144-a2f3-b97f35d157cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b08436d24c4104bcc1802366e41ad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:10Z,use_quota=True,user_id='fede98b35eba46a494fbe0d0fcd88974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Creating volume a8d65f74-933a-4144-a2f3-b97f35d157cf {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:56:29 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:29 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf 1073741824 Jul 07 17:56:29 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0e416317-f143-4fbe-8248-cace6573c939 tempest-GroupsV314Test-1587869617 None] Create group from source-group-25c396fd-214e-42a9-bb5d-1286e58f6888 completed successfully. Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Acquiring lock "cinder-quobyte-9dfd567f-6bfe-44ec-b184-e77929d94c33" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Lock "cinder-quobyte-9dfd567f-6bfe-44ec-b184-e77929d94c33" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34d997b-dbc4-4578-a702-705d78e16930]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:29 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 Jul 07 17:56:29 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:30 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf 1073741824" returned: 0 in 0.911s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:30 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf Jul 07 17:56:30 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:30 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33" returned: 0 in 0.800s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:30 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33 Jul 07 17:56:30 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:30 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf" returned: 0 in 0.686s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.145s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-481365127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec636e6-d44d-4515-9eef-f86dbe566348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6228e5b53df54720be6624de77d29e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:28Z,use_quota=True,user_id='0daa27979a344b189d749c8137fda392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Creating volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:56:30 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:30 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 1073741824 Jul 07 17:56:30 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab685b0d-70bc-4d03-a231-1da23d65b538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d65f74-933a-4144-a2f3-b97f35d157cf', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a374d2-04b8-4774-943d-7a44e6ed92df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:30 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Volume volume-a8d65f74-933a-4144-a2f3-b97f35d157cf (a8d65f74-933a-4144-a2f3-b97f35d157cf): created successfully Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a374d2-04b8-4774-943d-7a44e6ed92df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Flow 'volume_create_manager' (b4339347-5738-416b-b4ee-9aa5e86d2d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cbaacf6a-97a4-4ac0-a1b3-80a1bad2f88b tempest-VolumesTransfersV355Test-913127450 None] Created volume successfully. Jul 07 17:56:31 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9dfd567f-6bfe-44ec-b184-e77929d94c33" returned: 0 in 0.656s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Lock "cinder-quobyte-9dfd567f-6bfe-44ec-b184-e77929d94c33" released by "delete_volume" :: held 1.511s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Created reservations ['13c03f7c-2cb5-45fd-a533-c7cffe82bce3'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:31 devstack cinder-volume[87228]: WARNING cinder.quota [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-613848579 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-613848579, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:56:31 devstack cinder-volume[87228]: WARNING cinder.quota [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-613848579 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-613848579, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Created reservations ['320b18b5-4baf-4b8a-9c89-679487792e2a', '967c5e34-fc0c-4f1b-8f93-d30f83f7f69c', 'd1dee00b-7285-42b1-b9b6-99a6e2ff9097', 'd692b10c-4afb-466a-a779-35f3472642b2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:31 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:56:31 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:31 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 1073741824" returned: 0 in 0.941s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:31 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 Jul 07 17:56:31 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Acquiring lock "cinder-a8d65f74-933a-4144-a2f3-b97f35d157cf-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Lock "cinder-a8d65f74-933a-4144-a2f3-b97f35d157cf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Acquiring lock "cinder-quobyte-a8d65f74-933a-4144-a2f3-b97f35d157cf" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Lock "cinder-quobyte-a8d65f74-933a-4144-a2f3-b97f35d157cf" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fcdd8a-49fc-4bec-a1fb-34902a41fd1d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:32 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.763s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:56:32 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-28decb6a-177b-477d-8124-d7077afd9c3a tempest-GroupsV314Test-1587869617 None] Delete group completed successfully. Jul 07 17:56:32 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf Jul 07 17:56:32 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Acquiring lock "cinder-quobyte-10682f74-70c0-4f7b-9e98-d05c2469dc6b" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Lock "cinder-quobyte-10682f74-70c0-4f7b-9e98-d05c2469dc6b" acquired by "delete_volume" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef95d69-e421-4be3-82d5-8ad5c38fb521]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:32 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348" returned: 0 in 0.827s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5966dd93-6956-4d08-93c6-69fded51013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec636e6-d44d-4515-9eef-f86dbe566348', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe63ca3e-f61a-4c8f-a312-30be605da50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:32 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Volume volume-0ec636e6-d44d-4515-9eef-f86dbe566348 (0ec636e6-d44d-4515-9eef-f86dbe566348): created successfully Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe63ca3e-f61a-4c8f-a312-30be605da50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Flow 'volume_create_manager' (33968762-0fbd-4fc4-8603-f521006ba22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:32 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b622c6db-a6b6-4e57-8c2c-27456c215225 tempest-SnapshotsActionsTest-416303468 None] Created volume successfully. Jul 07 17:56:32 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b Jul 07 17:56:32 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:33 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf" returned: 0 in 0.949s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:33 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf Jul 07 17:56:33 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:33 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b" returned: 0 in 0.927s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:33 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b Jul 07 17:56:33 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:33 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a8d65f74-933a-4144-a2f3-b97f35d157cf" returned: 0 in 0.733s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Lock "cinder-quobyte-a8d65f74-933a-4144-a2f3-b97f35d157cf" released by "delete_volume" :: held 1.758s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Created reservations ['8b3e54b2-123b-4999-b147-6886f0d378af', 'c5fda8a3-9a14-43be-81e8-ec6229285516', '591a03d0-4ecf-4356-88db-4a2874e3f36a', 'b90f54c1-e39f-47a5-ab44-79004c20f906'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Creating offline snapshot ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:56:34 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:56:34 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb1ecb3-0dd5-423f-8ebe-f03af6472de9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:34 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-10682f74-70c0-4f7b-9e98-d05c2469dc6b" returned: 0 in 0.836s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Lock "cinder-quobyte-10682f74-70c0-4f7b-9e98-d05c2469dc6b" released by "delete_volume" :: held 1.850s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:34 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 Jul 07 17:56:34 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Created reservations ['cd4d3015-ccae-439f-8897-d25dbcb6f7c6'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Created reservations ['632ab8a0-c9b9-4eae-8ac9-42e6bb389177', 'd9f4d4ea-532e-42b3-b2d4-faf3a26f717a', '26ec3666-6c7d-49cd-837f-17afbed432ff', '1dc45582-40bb-4286-a575-9f9056bee494'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:35 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:56:35 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:35 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.174s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:35 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:56:35 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Deleted volume successfully. Jul 07 17:56:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ddd86790-86a9-458c-b9eb-0c1de59bcf0f tempest-VolumesTransfersV355Test-1058384372 None] Lock "cinder-a8d65f74-933a-4144-a2f3-b97f35d157cf-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:35 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348" returned: 0 in 1.451s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:35 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b 1G Jul 07 17:56:35 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:36 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.033s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:36 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:56:36 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6c74f3f8-e823-4130-bf7e-1e4d7c7bd2ab tempest-GroupsV314Test-1587869617 None] Delete group completed successfully. Jul 07 17:56:36 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b 1G" returned: 0 in 0.956s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:36 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:56:36 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:37 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.834s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:37 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b is being set with open permissions: ugo+rw Jul 07 17:56:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:37 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:56:37 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:38 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.834s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:38 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.info Jul 07 17:56:38 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:39 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.info" returned: 0 in 0.764s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:39 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.info is being set with open permissions: ugo+rw Jul 07 17:56:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:39 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.info Jul 07 17:56:39 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:40 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.info" returned: 0 in 0.940s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.974s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:40 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c9c9ab36-bc2a-47a8-be96-142a93d98910 tempest-SnapshotsActionsTest-416303468 None] Create snapshot completed successfully Jul 07 17:56:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Creating offline snapshot 7932785d-9490-4d6d-9618-960bd69eece7 of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:56:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[086cf8c7-62d6-4260-ab46-48ba7f046c03]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:41 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:56:41 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:42 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.915s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:56:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:42 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 1G Jul 07 17:56:42 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Flow 'volume_create_manager' (7e8c2989-03bd-47e3-aa6a-b71ca0f09440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82e618b-bb0a-4cbc-9b3e-3f0cc91bbee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82e618b-bb0a-4cbc-9b3e-3f0cc91bbee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1713285189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2303bb0-59b4-4538-b4c0-25b467775afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2bd77301884ebabb2a2af81d977444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:43Z,use_quota=True,user_id='a18f2772ed794694b0d44b9b9644a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e364f664-7d4f-4e42-9da5-79615bd13751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e364f664-7d4f-4e42-9da5-79615bd13751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bf8d59-425f-4582-bd0d-14e453ffd6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:56:43 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 1G" returned: 0 in 0.965s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:43 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 Jul 07 17:56:43 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bf8d59-425f-4582-bd0d-14e453ffd6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2303bb0-59b4-4538-b4c0-25b467775afa', 'volume_name': 'volume-f2303bb0-59b4-4538-b4c0-25b467775afa', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2875439f-72c4-4313-a0eb-357da4e05ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2875439f-72c4-4313-a0eb-357da4e05ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7390abd4-ca6d-475f-9f8a-98b304a7dd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:43 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Volume f2303bb0-59b4-4538-b4c0-25b467775afa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2303bb0-59b4-4538-b4c0-25b467775afa', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:56:43 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Trying to clone f2303bb0-59b4-4538-b4c0-25b467775afa from image e34b77ca-f38c-49a7-885f-cd463a6fcc7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 17:56:44 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:56:44 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:56:44 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2ad15f-c74b-45b8-b5bb-b14e8a98aa85]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:44 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7" returned: 0 in 0.864s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:44 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 is being set with open permissions: ugo+rw Jul 07 17:56:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:44 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 Jul 07 17:56:44 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:44 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD Jul 07 17:56:44 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:45 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7" returned: 0 in 0.798s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:45 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.712s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:45 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Temporary image e34b77ca-f38c-49a7-885f-cd463a6fcc7d is fetched for user a18f2772ed794694b0d44b9b9644a99a. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:56:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c0039e3c-c046-4dc9-abe3-fa84fb475c22 tempest-SnapshotsActionsTest-416303468 None] Create snapshot completed successfully Jul 07 17:56:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd156691-3c8c-46de-8f92-1089db09ffad]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:45 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD Jul 07 17:56:45 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:46 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD" returned: 0 in 0.875s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1713285189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2303bb0-59b4-4538-b4c0-25b467775afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2bd77301884ebabb2a2af81d977444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:43Z,use_quota=True,user_id='a18f2772ed794694b0d44b9b9644a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Creating volume f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:56:46 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:46 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa 1073741824 Jul 07 17:56:46 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-7932785d-9490-4d6d-9618-960bd69eece7-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-7932785d-9490-4d6d-9618-960bd69eece7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-quobyte-7932785d-9490-4d6d-9618-960bd69eece7" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-7932785d-9490-4d6d-9618-960bd69eece7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Deleting offline snapshot 7932785d-9490-4d6d-9618-960bd69eece7 of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] snapshot_file for this snap is: volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a97064-4d18-4aa0-91f6-b4cb75f93d88]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:46 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 Jul 07 17:56:46 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:47 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:47 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7" returned: 0 in 1.008s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:56:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa 1073741824" returned: 0 in 1.216s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:47 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ca722b-4aac-415b-9a3d-ef8dd7abd89c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:47 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:56:47 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:47 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:56:47 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:48 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 0 in 0.920s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Attempting download of e34b77ca-f38c-49a7-885f-cd463a6fcc7d ((None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}])) to volume f2303bb0-59b4-4538-b4c0-25b467775afa. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:56:48 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 1.060s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:48 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 Jul 07 17:56:48 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8729c978-4332-42ba-9277-25e7ab2feacd]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_u7sj9zqc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:48 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_u7sj9zqc Jul 07 17:56:48 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:49 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_u7sj9zqc" returned: 0 in 0.891s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_u7sj9zqc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:49 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7" returned: 0 in 1.020s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:49 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7 Jul 07 17:56:49 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:49 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_u7sj9zqc Jul 07 17:56:49 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Flow 'volume_create_manager' (e3ebcebc-6efb-404d-a01e-0814dfce0966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f6936-5a79-4c2a-bc21-ed409ca8dd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f6936-5a79-4c2a-bc21-ed409ca8dd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1995872118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40caca1-db07-427b-b0cb-7a02878f8927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26225eb1ec74491b9ceb1369cb8fcc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:50Z,use_quota=True,user_id='a96cf846ef564be99659d46b6c15be03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c95838-7991-49ca-a22f-1fff83e897f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c95838-7991-49ca-a22f-1fff83e897f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d27081-a3d1-4c48-ba1d-ba21d5e78363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d27081-a3d1-4c48-ba1d-ba21d5e78363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40caca1-db07-427b-b0cb-7a02878f8927', 'volume_name': 'volume-b40caca1-db07-427b-b0cb-7a02878f8927', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df66e8d-a1b1-4c3e-8632-6955e0847c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df66e8d-a1b1-4c3e-8632-6955e0847c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa602cec-1164-42f8-b475-cdd8d51bf5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:50 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Volume b40caca1-db07-427b-b0cb-7a02878f8927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40caca1-db07-427b-b0cb-7a02878f8927', 'volume_size': 1} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1995872118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40caca1-db07-427b-b0cb-7a02878f8927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26225eb1ec74491b9ceb1369cb8fcc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:56:50Z,use_quota=True,user_id='a96cf846ef564be99659d46b6c15be03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Creating volume b40caca1-db07-427b-b0cb-7a02878f8927 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:56:50 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:50 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 1073741824 Jul 07 17:56:50 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:50 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.7932785d-9490-4d6d-9618-960bd69eece7" returned: 0 in 0.840s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-7932785d-9490-4d6d-9618-960bd69eece7" released by "_delete_snapshot" :: held 4.078s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" released by "delete_snapshot" :: held 4.121s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:50 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_u7sj9zqc" returned: 1 in 1.019s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_u7sj9zqc' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3671bee7-c1a1-4e1a-a898-689824a68b7e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Created reservations ['1c0ef407-44fb-4d00-b222-4228f9653b7b', 'c056e2bd-1a50-4af2-957b-a0eef9aa6049', 'b59433d6-e6d5-40c4-8a8b-ac4c3e38edd2', '817da854-7062-4ee6-8495-d4595d2efde8'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Delete snapshot completed successfully. Jul 07 17:56:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-12e7ed8d-5870-44f2-96bf-17a2317db31e tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-7932785d-9490-4d6d-9618-960bd69eece7-delete_snapshot" released by "delete_snapshot" :: held 4.349s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:50 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD Jul 07 17:56:50 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:51 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 1073741824" returned: 0 in 1.049s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:51 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 Jul 07 17:56:51 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:51 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:51 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] e34b77ca-f38c-49a7-885f-cd463a6fcc7d was qcow2, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:56:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:51 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:56:51 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:52 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927" returned: 0 in 0.809s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.077s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Creating offline snapshot 30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa602cec-1164-42f8-b475-cdd8d51bf5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40caca1-db07-427b-b0cb-7a02878f8927', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a036c47-e424-405e-9565-994d8e56af64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8121088-5542-47e3-a836-66accc561ed7]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:52 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Volume volume-b40caca1-db07-427b-b0cb-7a02878f8927 (b40caca1-db07-427b-b0cb-7a02878f8927): created successfully Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a036c47-e424-405e-9565-994d8e56af64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Flow 'volume_create_manager' (e3ebcebc-6efb-404d-a01e-0814dfce0966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:52 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-35f33eda-7848-4dbc-bce8-f668bc768aec tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Created volume successfully. Jul 07 17:56:52 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:56:52 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:53 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.868s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:56:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:53 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe 1G Jul 07 17:56:53 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:53 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 0 in 2.202s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:53 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_l84whljidevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:56:53 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Converted 112.00 MB image at 50.84 MB/s Jul 07 17:56:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:53 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa 1G Jul 07 17:56:53 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:54 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe 1G" returned: 0 in 0.968s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:54 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe Jul 07 17:56:54 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:54 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa 1G" returned: 0 in 0.840s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[856bb51c-851f-4443-a492-8b38f69704f9]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Acquiring lock "cinder-b40caca1-db07-427b-b0cb-7a02878f8927-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "cinder-b40caca1-db07-427b-b0cb-7a02878f8927-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Acquiring lock "cinder-quobyte-b40caca1-db07-427b-b0cb-7a02878f8927" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:54 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:56:54 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "cinder-quobyte-b40caca1-db07-427b-b0cb-7a02878f8927" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9b1c46-e7a8-456a-9fa5-19c0ae7992e1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:54 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 Jul 07 17:56:54 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:54 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe" returned: 0 in 0.828s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:54 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe is being set with open permissions: ugo+rw Jul 07 17:56:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:55 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe Jul 07 17:56:55 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:55 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 0 in 1.003s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:55 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:56:55 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:55 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe" returned: 0 in 0.843s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.660s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:55 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927" returned: 0 in 1.149s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:55 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927 Jul 07 17:56:55 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-af8d1d4a-1713-464e-bdc6-cfec8489e2b7 tempest-SnapshotsActionsTest-416303468 None] Create snapshot completed successfully Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-quobyte-30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Deleting offline snapshot 30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] snapshot_file for this snap is: volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6234088-a75a-4ce6-a15a-c0a90e5b810b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:56 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 1 in 1.174s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Downloaded image e34b77ca-f38c-49a7-885f-cd463a6fcc7d ((None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}])) to volume f2303bb0-59b4-4538-b4c0-25b467775afa successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Temporary image e34b77ca-f38c-49a7-885f-cd463a6fcc7d for user a18f2772ed794694b0d44b9b9644a99a is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Marking volume f2303bb0-59b4-4538-b4c0-25b467775afa as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Copying metadata from image e34b77ca-f38c-49a7-885f-cd463a6fcc7d to f2303bb0-59b4-4538-b4c0-25b467775afa. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Creating volume glance metadata for volume f2303bb0-59b4-4538-b4c0-25b467775afa backed by image e34b77ca-f38c-49a7-885f-cd463a6fcc7d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:56:56 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b40caca1-db07-427b-b0cb-7a02878f8927" returned: 0 in 0.917s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:56 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe Jul 07 17:56:56 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "cinder-quobyte-b40caca1-db07-427b-b0cb-7a02878f8927" released by "delete_volume" :: held 2.148s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Created reservations ['063f5688-a820-4222-bf85-551b05a490c7', '65f8c718-94d8-48e9-8ddd-bc8fb2ac42dd', '12c52926-5311-42ce-9183-d112bd8f3f82', '4bf75f93-f2dd-4a1e-ad7c-f1009e778287'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7390abd4-ca6d-475f-9f8a-98b304a7dd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2303bb0-59b4-4538-b4c0-25b467775afa', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0248cdb0-479d-41b2-8d8e-02966e9c2d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:56:57 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Volume volume-f2303bb0-59b4-4538-b4c0-25b467775afa (f2303bb0-59b4-4538-b4c0-25b467775afa): created successfully Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0248cdb0-479d-41b2-8d8e-02966e9c2d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Flow 'volume_create_manager' (7e8c2989-03bd-47e3-aa6a-b71ca0f09440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:56:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-81ef5f51-920e-4f1c-8b11-cc1c1b09091f tempest-VolumesExtendTest-908798845 None] Created volume successfully. Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:57 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:56:57 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04813fa-0f21-45dc-90fe-0a31171dc215]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:57 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:56:57 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:58 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe" returned: 0 in 1.357s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:56:58 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.961s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:56:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Deleted volume successfully. Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc16d6c-c3cd-43be-845c-fa19d7906a13]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21d78fcb-8879-4464-9b98-65b262314fc9 tempest-VolumeQuotasNegativeTestJSON-1978381966 None] Lock "cinder-b40caca1-db07-427b-b0cb-7a02878f8927-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:56:58 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:56:58 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:58 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 0 in 1.011s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:58 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:56:58 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:59 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.926s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:56:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:59 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe Jul 07 17:56:59 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:59 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 1 in 0.902s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:56:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa 2G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa 2G" returned: 0 in 0.067s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.060s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:56:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cb1783cb-cb0e-47f5-9704-f8203d987cda tempest-VolumesExtendTest-908798845 None] Extend volume completed successfully. Jul 07 17:57:00 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe" returned: 0 in 0.988s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:00 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe Jul 07 17:57:00 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Acquiring lock "cinder-f2303bb0-59b4-4538-b4c0-25b467775afa-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Lock "cinder-f2303bb0-59b4-4538-b4c0-25b467775afa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Acquiring lock "cinder-quobyte-f2303bb0-59b4-4538-b4c0-25b467775afa" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Lock "cinder-quobyte-f2303bb0-59b4-4538-b4c0-25b467775afa" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea14af9f-b511-4661-bb67-6578ae666781]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:00 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:57:00 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:00 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe" returned: 0 in 0.895s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe" released by "_delete_snapshot" :: held 4.310s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" released by "delete_snapshot" :: held 4.345s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:01 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Created reservations ['ea0b2ca4-55c6-4428-92f6-46816a133def', '43921340-2c4f-469a-b615-3674dccb324e', '26b431c9-bf86-4ded-989a-c9c779692363', '08a74e1d-89ba-4b2e-a0df-10be08ba6c20'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:01 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Delete snapshot completed successfully. Jul 07 17:57:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3ca63180-ca53-43a4-bdb6-e597820036d3 tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-30eaf30a-6cb0-47cb-8abc-8cd1e84f2bfe-delete_snapshot" released by "delete_snapshot" :: held 4.518s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:01 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 0 in 0.916s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:01 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:57:01 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:02 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 1 in 1.049s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:02 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa Jul 07 17:57:02 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Creating offline snapshot 5ce824c6-6f8a-4cfc-85cd-573be9059864 of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:57:02 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff07adc-b5ee-4c64-a9ca-86fff2206a03]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:02 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:57:02 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:03 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f2303bb0-59b4-4538-b4c0-25b467775afa" returned: 0 in 0.883s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Lock "cinder-quobyte-f2303bb0-59b4-4538-b4c0-25b467775afa" released by "delete_volume" :: held 2.938s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Created reservations ['93888aca-f1b7-47c4-b947-ac4a4caf8874', '8c11d133-da18-48bc-b1b2-fc08d90b8ab6', '5717a31a-de91-4b4b-903a-7bc8b59cea1e', 'c2288a33-fbda-4d75-a3e6-c10f3ecdc4dd'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:03 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:57:03 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:03 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 1.245s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:57:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:04 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 1G Jul 07 17:57:04 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:04 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.095s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Flow 'volume_create_manager' (38931aed-06be-4752-9aa2-45ea87d638f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc91331-73a2-41f0-8958-f71ab0edcb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Deleted volume successfully. Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc91331-73a2-41f0-8958-f71ab0edcb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-15672322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ebd9e5-7335-43a2-bb03-3f22705848ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2bd77301884ebabb2a2af81d977444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:04Z,use_quota=True,user_id='a18f2772ed794694b0d44b9b9644a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa117cc-0eef-424a-a3d5-087e2929a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa117cc-0eef-424a-a3d5-087e2929a946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8026a921-d8c7-4457-85eb-b366c94155a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8026a921-d8c7-4457-85eb-b366c94155a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ebd9e5-7335-43a2-bb03-3f22705848ac', 'volume_name': 'volume-15ebd9e5-7335-43a2-bb03-3f22705848ac', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cdca72-5f30-423c-8773-385e173f8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cdca72-5f30-423c-8773-385e173f8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1ce728-f526-47ec-81da-730c1d8f8903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:04 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Volume 15ebd9e5-7335-43a2-bb03-3f22705848ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ebd9e5-7335-43a2-bb03-3f22705848ac', 'volume_size': 1} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e24b6d57-cb90-499a-b6fb-ca944e062adb tempest-VolumesExtendTest-908798845 None] Lock "cinder-f2303bb0-59b4-4538-b4c0-25b467775afa-delete_volume" released by "delete_volume" :: held 4.567s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:05 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 1G" returned: 0 in 1.485s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:05 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 Jul 07 17:57:05 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Flow 'volume_create_manager' (9f1e0c99-864e-40b3-83c4-e889c9cfad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532a805d-cc8c-4e52-9a75-774f82241b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532a805d-cc8c-4e52-9a75-774f82241b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1014433636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f0b355-3074-46e7-afa7-f019f4200237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246f5860113740ff99e2c2831f7e3ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:05Z,use_quota=True,user_id='0f60cfe252864a049b95fd98d41068f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c3f3455-c489-4244-8235-de4dc2dc8e21),volume_type_id=5c3f3455-c489-4244-8235-de4dc2dc8e21)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1732303e-27bd-4982-ad4c-42bfe1579486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1732303e-27bd-4982-ad4c-42bfe1579486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d959d02e-58af-4d75-8fbd-0eedb35b8f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d959d02e-58af-4d75-8fbd-0eedb35b8f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f0b355-3074-46e7-afa7-f019f4200237', 'volume_name': 'volume-92f0b355-3074-46e7-afa7-f019f4200237', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1586de9-625e-41ae-a541-0cc46620502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1586de9-625e-41ae-a541-0cc46620502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9548589d-c9db-45bc-ab70-c21d1474098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:05 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Volume 92f0b355-3074-46e7-afa7-f019f4200237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f0b355-3074-46e7-afa7-f019f4200237', 'volume_size': 1} Jul 07 17:57:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:06 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864" returned: 0 in 0.789s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:06 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 is being set with open permissions: ugo+rw Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:06 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 Jul 07 17:57:06 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:06 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864" returned: 0 in 0.719s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=110,cinder:INSERT=29,cinder:UPDATE=115,cinder:DELETE=7 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.395s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-15672322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ebd9e5-7335-43a2-bb03-3f22705848ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d2bd77301884ebabb2a2af81d977444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:04Z,use_quota=True,user_id='a18f2772ed794694b0d44b9b9644a99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Creating volume 15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:07 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:07 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac 1073741824 Jul 07 17:57:07 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-073ba4bf-fe36-43b5-85c9-22e20a7b4f78 tempest-SnapshotsActionsTest-416303468 None] Create snapshot completed successfully Jul 07 17:57:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-5ce824c6-6f8a-4cfc-85cd-573be9059864-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-5ce824c6-6f8a-4cfc-85cd-573be9059864-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-quobyte-5ce824c6-6f8a-4cfc-85cd-573be9059864" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-5ce824c6-6f8a-4cfc-85cd-573be9059864" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Deleting offline snapshot 5ce824c6-6f8a-4cfc-85cd-573be9059864 of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] snapshot_file for this snap is: volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6cad63-2f30-4f59-aea1-81eae22b3c81]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:08 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac 1073741824" returned: 0 in 1.118s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=99,cinder:UPDATE=113,cinder:INSERT=36,cinder:DELETE=6 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:08 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac Jul 07 17:57:08 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:08 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 Jul 07 17:57:08 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:08 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac" returned: 0 in 0.751s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.298s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1014433636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f0b355-3074-46e7-afa7-f019f4200237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='246f5860113740ff99e2c2831f7e3ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:05Z,use_quota=True,user_id='0f60cfe252864a049b95fd98d41068f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c3f3455-c489-4244-8235-de4dc2dc8e21),volume_type_id=5c3f3455-c489-4244-8235-de4dc2dc8e21)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Creating volume 92f0b355-3074-46e7-afa7-f019f4200237 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:08 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1ce728-f526-47ec-81da-730c1d8f8903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ebd9e5-7335-43a2-bb03-3f22705848ac', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e361b9-a5c4-4e1e-acf9-c83aba349509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:08 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864" returned: 0 in 0.912s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:57:08 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 1073741824 Jul 07 17:57:08 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:09 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Volume volume-15ebd9e5-7335-43a2-bb03-3f22705848ac (15ebd9e5-7335-43a2-bb03-3f22705848ac): created successfully Jul 07 17:57:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e361b9-a5c4-4e1e-acf9-c83aba349509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Flow 'volume_create_manager' (38931aed-06be-4752-9aa2-45ea87d638f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:09 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad6065-dfbf-4cae-9298-2a80615a1b4e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:09 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1a00ece9-01b7-4b87-be3b-bd76a492bc80 tempest-VolumesExtendTest-908798845 None] Created volume successfully. Jul 07 17:57:09 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:57:09 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:09 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.866s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:57:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:09 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 Jul 07 17:57:09 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:09 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 1073741824" returned: 0 in 1.026s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:10 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 Jul 07 17:57:10 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:10 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864" returned: 0 in 0.833s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:10 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864 Jul 07 17:57:10 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:10 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237" returned: 0 in 0.778s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.670s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9548589d-c9db-45bc-ab70-c21d1474098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f0b355-3074-46e7-afa7-f019f4200237', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25446d73-0196-40ab-9c24-10801b8ccf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Creating offline snapshot f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 of volume 15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd25d15-1f43-41b0-a818-fa2feadfb064]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:10 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Volume volume-92f0b355-3074-46e7-afa7-f019f4200237 (92f0b355-3074-46e7-afa7-f019f4200237): created successfully Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25446d73-0196-40ab-9c24-10801b8ccf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Flow 'volume_create_manager' (9f1e0c99-864e-40b3-83c4-e889c9cfad02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6b756958-389e-4d9d-b689-4839443c53b8 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Created volume successfully. Jul 07 17:57:11 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac Jul 07 17:57:11 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:11 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.5ce824c6-6f8a-4cfc-85cd-573be9059864" returned: 0 in 0.698s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-5ce824c6-6f8a-4cfc-85cd-573be9059864" released by "_delete_snapshot" :: held 3.422s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" released by "delete_snapshot" :: held 3.456s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:11 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Created reservations ['3751aec2-84a9-4af9-8be8-dd9e10e7300d', '1bcea51a-a105-4ac9-aaee-9afe20f2a525', '9b160a60-be1f-4bf9-bbc9-6e92eaf00565', '07c340f2-e883-4808-9c57-a3b9c027f804'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:11 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Delete snapshot completed successfully. Jul 07 17:57:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e098f488-bb12-4aac-adcf-92f467728b3f tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-5ce824c6-6f8a-4cfc-85cd-573be9059864-delete_snapshot" released by "delete_snapshot" :: held 3.613s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:11 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac" returned: 0 in 0.850s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:11 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 1G Jul 07 17:57:11 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:12 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:57:12 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:12 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 1G" returned: 0 in 0.993s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ebd9e5-7335-43a2-bb03-3f22705848ac -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:12 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ebd9e5-7335-43a2-bb03-3f22705848ac -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 Jul 07 17:57:12 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:13 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.723s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:13 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-31bf30e0-b00d-4f58-8008-306dddf15871 tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Retype volume completed successfully. Jul 07 17:57:13 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ebd9e5-7335-43a2-bb03-3f22705848ac -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747" returned: 0 in 0.684s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:13 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 is being set with open permissions: ugo+rw Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:13 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 Jul 07 17:57:13 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Acquiring lock "cinder-92f0b355-3074-46e7-afa7-f019f4200237-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "cinder-92f0b355-3074-46e7-afa7-f019f4200237-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Acquiring lock "cinder-quobyte-92f0b355-3074-46e7-afa7-f019f4200237" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "cinder-quobyte-92f0b355-3074-46e7-afa7-f019f4200237" acquired by "delete_volume" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8764e740-8108-41b2-9f14-bc4dc49d450b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:14 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 Jul 07 17:57:14 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:14 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747" returned: 0 in 0.747s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:14 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.info Jul 07 17:57:14 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:14 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237" returned: 0 in 0.793s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:14 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237 Jul 07 17:57:14 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:14 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.info" returned: 0 in 0.727s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:14 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.info is being set with open permissions: ugo+rw Jul 07 17:57:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:14 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.info Jul 07 17:57:14 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:15 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-92f0b355-3074-46e7-afa7-f019f4200237" returned: 0 in 0.710s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "cinder-quobyte-92f0b355-3074-46e7-afa7-f019f4200237" released by "delete_volume" :: held 1.561s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:15 devstack cinder-volume[87228]: WARNING cinder.quota [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:57:15 devstack cinder-volume[87228]: WARNING cinder.quota [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Created reservations ['f4a6fb2b-7097-4032-a124-179b2c7801ab', 'fa82000c-6154-435a-9af5-035d79729be3', '0cd8a932-f739-4bc9-924a-797f117db0e6', 'f17c8ffb-28c1-4aca-929a-d8e901ccaf38'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:15 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.info" returned: 0 in 0.675s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:15 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:57:15 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.811s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.869s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Creating offline snapshot f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ceed6-a0a6-4825-82f1-dd94e5ec8ff2]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:15 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-03311d7e-1c2d-4138-903b-56ac890a8a45 tempest-VolumesExtendTest-908798845 None] Create snapshot completed successfully Jul 07 17:57:15 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:57:15 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:16 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.783s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:16 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Deleted volume successfully. Jul 07 17:57:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-24854c94-431a-4e40-a7e8-e576d9d87e5b tempest-VolumeRetypeWithoutMigrationTest-1121047952 None] Lock "cinder-92f0b355-3074-46e7-afa7-f019f4200237-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f52fe834-ca5c-4f96-ab52-a1ced1528046 tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:16 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 1.027s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:57:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:16 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 1G Jul 07 17:57:16 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:17 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 1G" returned: 0 in 0.940s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:17 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 Jul 07 17:57:17 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:18 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14" returned: 0 in 0.747s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:18 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 is being set with open permissions: ugo+rw Jul 07 17:57:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:18 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 Jul 07 17:57:18 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:19 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14" returned: 0 in 0.654s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.475s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f52fe834-ca5c-4f96-ab52-a1ced1528046 tempest-VolumesExtendTest-908798845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.428s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:19 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c8d622-6c27-442e-be7a-a781639d36ad]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f52fe834-ca5c-4f96-ab52-a1ced1528046 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-023bd9f2-4584-4066-b7d6-210f2d0c5bdc tempest-SnapshotsActionsTest-416303468 None] Create snapshot completed successfully Jul 07 17:57:19 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac Jul 07 17:57:19 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:19 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f52fe834-ca5c-4f96-ab52-a1ced1528046 tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac" returned: 0 in 0.877s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f52fe834-ca5c-4f96-ab52-a1ced1528046 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 2G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f52fe834-ca5c-4f96-ab52-a1ced1528046 tempest-VolumesExtendTest-908798845 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 2G" returned: 0 in 0.194s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f52fe834-ca5c-4f96-ab52-a1ced1528046 tempest-VolumesExtendTest-908798845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.118s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Acquiring lock "cinder-quobyte-f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f52fe834-ca5c-4f96-ab52-a1ced1528046 tempest-VolumesExtendTest-908798845 None] Extend volume completed successfully. Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Deleting offline snapshot f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] snapshot_file for this snap is: volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f57e0-fab1-47df-b469-e03aaf852d8d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:20 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 Jul 07 17:57:20 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Acquiring lock "cinder-f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:21 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14" returned: 0 in 0.865s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Lock "cinder-f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Acquiring lock "cinder-quobyte-15ebd9e5-7335-43a2-bb03-3f22705848ac" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Lock "cinder-quobyte-15ebd9e5-7335-43a2-bb03-3f22705848ac" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Acquiring lock "cinder-quobyte-f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd33acd1-23eb-45dc-8a4b-14dc7eea08ea]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Lock "cinder-quobyte-f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Deleting offline snapshot f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 of volume 15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] snapshot_file for this snap is: volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebff7050-e7ec-4c10-b28d-0f36f7d1cf63]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:21 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:57:21 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:21 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 Jul 07 17:57:21 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:22 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.924s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:57:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:22 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747" returned: 0 in 0.886s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ebd9e5-7335-43a2-bb03-3f22705848ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:57:22 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 Jul 07 17:57:22 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9524b8-ea46-463b-adda-91d9c446bcde]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:22 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac Jul 07 17:57:22 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:23 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14" returned: 0 in 0.897s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:23 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14 Jul 07 17:57:23 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:23 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac" returned: 0 in 0.889s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:23 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 Jul 07 17:57:23 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:23 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:57:23 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:24 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14" returned: 0 in 0.942s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14" released by "_delete_snapshot" :: held 3.768s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" released by "delete_snapshot" :: held 3.807s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:24 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Created reservations ['d3cf61ea-5647-49f2-9274-53bdb919a5ce', '8d03a3ee-8954-4c7d-9d96-8d1d0da0f634', '047bffd8-28f7-4131-a8ce-26498bb52643', 'd1c6b464-244d-41bc-964a-b5d615fab57d'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Delete snapshot completed successfully. Jul 07 17:57:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-305f65ae-e57f-4cff-a027-c87a4564a4cf tempest-SnapshotsActionsTest-2135457925 None] Lock "cinder-f2b9f7b4-4c33-4f5d-8c20-7d3bf4a9bb14-delete_snapshot" released by "delete_snapshot" :: held 4.082s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:24 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747" returned: 0 in 1.270s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:24 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747 Jul 07 17:57:24 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:25 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.233s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "cinder-ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "cinder-quobyte-ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-quobyte-ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Deleting offline snapshot ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b of volume 0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] snapshot_file for this snap is: volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5907de8-4044-43f6-afc3-d5f075c27fa3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:25 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac.f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747" returned: 0 in 1.013s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:25 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:57:25 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Lock "cinder-quobyte-f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747" released by "_delete_snapshot" :: held 4.208s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Lock "cinder-quobyte-15ebd9e5-7335-43a2-bb03-3f22705848ac" released by "delete_snapshot" :: held 4.257s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Created reservations ['dca994e8-d01f-45be-9386-6c3c78b31529', 'b9f49bcd-42fc-4bfa-a3d8-433964a2e780', 'a7d0101f-e53d-4aa2-8030-c86a87165e0d', 'ec6ece6e-3487-406b-8d03-5a6621f8fc68'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Delete snapshot completed successfully. Jul 07 17:57:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fa70bc3d-6304-4796-9f44-fba4667c9da2 tempest-VolumesExtendTest-908798845 None] Lock "cinder-f38ef6f9-87e6-4a15-8d4a-2aacc9e0d747-delete_snapshot" released by "delete_snapshot" :: held 4.435s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:26 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.934s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec636e6-d44d-4515-9eef-f86dbe566348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00b354-6da6-49c3-8856-6b5955506c75]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:26 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 Jul 07 17:57:26 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Acquiring lock "cinder-15ebd9e5-7335-43a2-bb03-3f22705848ac-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Lock "cinder-15ebd9e5-7335-43a2-bb03-3f22705848ac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Acquiring lock "cinder-quobyte-15ebd9e5-7335-43a2-bb03-3f22705848ac" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Lock "cinder-quobyte-15ebd9e5-7335-43a2-bb03-3f22705848ac" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fefe997-6215-483a-88df-5608ed892c5f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:26 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac Jul 07 17:57:26 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:27 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348" returned: 0 in 0.865s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:27 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:57:27 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:27 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac" returned: 0 in 1.041s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:27 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac Jul 07 17:57:27 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:28 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 1.026s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:28 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b Jul 07 17:57:28 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Flow 'volume_create_manager' (e0031f05-1b0d-4569-8bd8-ee94f1ada020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901dd8a4-27e8-4f25-b0af-bb6bb025a543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901dd8a4-27e8-4f25-b0af-bb6bb025a543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1670925700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28a1c0f-2b17-4ee6-9793-dac9ab13c181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972427dcb6d9477b87a46d5566dffa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:28Z,use_quota=True,user_id='e2151cd943894b74bf821245b6c1d9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ed8937-86e5-4862-a0d2-3398d5d18295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ed8937-86e5-4862-a0d2-3398d5d18295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702c8c8b-00dd-47c0-9e6d-f8df58f188e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702c8c8b-00dd-47c0-9e6d-f8df58f188e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28a1c0f-2b17-4ee6-9793-dac9ab13c181', 'volume_name': 'volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3599b3-736b-45e3-8029-f62c376e7af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3599b3-736b-45e3-8029-f62c376e7af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d48807-3485-448b-aac4-8dda6ca076ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:28 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Volume a28a1c0f-2b17-4ee6-9793-dac9ab13c181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181', 'volume_size': 1} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1670925700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28a1c0f-2b17-4ee6-9793-dac9ab13c181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972427dcb6d9477b87a46d5566dffa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:28Z,use_quota=True,user_id='e2151cd943894b74bf821245b6c1d9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Creating volume a28a1c0f-2b17-4ee6-9793-dac9ab13c181 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:28 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:28 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 1073741824 Jul 07 17:57:28 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:28 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-15ebd9e5-7335-43a2-bb03-3f22705848ac" returned: 0 in 0.906s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Lock "cinder-quobyte-15ebd9e5-7335-43a2-bb03-3f22705848ac" released by "delete_volume" :: held 2.027s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Created reservations ['97ab7933-3d23-4c30-a5e3-e6624504eab5', 'e13ab7cc-8573-4926-8576-ef9a3b982542', '115797a9-5040-4ca3-85c5-48c74b955df0', '3886f2c3-b7f0-4a9c-8425-272f6fdff47c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:29 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:57:29 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:29 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348.ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" returned: 0 in 0.972s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-quobyte-ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b" released by "_delete_snapshot" :: held 3.952s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" released by "delete_snapshot" :: held 3.986s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Created reservations ['174c044e-cafe-4466-a469-806212529525', '197d4a50-33f4-4c39-a8ae-6edaad2248f0', '0bfe9cf1-53c7-4271-ad2f-3e7f9c9ade22', '876e1213-62d4-4db6-989e-4f69857ebe0c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Delete snapshot completed successfully. Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6e438d69-e34e-4ff0-b26a-ec59d766724e tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-ea9ff9a7-8c3a-45e4-a3e2-d5b738e4ba6b-delete_snapshot" released by "delete_snapshot" :: held 4.293s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:29 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 1073741824" returned: 0 in 1.199s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:29 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 Jul 07 17:57:29 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:29 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.877s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Deleted volume successfully. Jul 07 17:57:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-dfc394dd-a205-458e-8c4f-f870fb236d96 tempest-VolumesExtendTest-908798845 None] Lock "cinder-15ebd9e5-7335-43a2-bb03-3f22705848ac-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "cinder-0ec636e6-d44d-4515-9eef-f86dbe566348-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:30 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181" returned: 0 in 0.930s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.194s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-0ec636e6-d44d-4515-9eef-f86dbe566348-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d48807-3485-448b-aac4-8dda6ca076ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d3808b-c5f4-4f85-8313-8b80c72643d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:30 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Volume volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 (a28a1c0f-2b17-4ee6-9793-dac9ab13c181): created successfully Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d3808b-c5f4-4f85-8313-8b80c72643d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Flow 'volume_create_manager' (e0031f05-1b0d-4569-8bd8-ee94f1ada020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d59e1f6e-7623-4b3d-a2aa-9c06f5e18156 tempest-AttachVolumeTestJSON-357092893 None] Created volume successfully. Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" acquired by "delete_volume" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea4817a-8394-43e5-abea-d32e2c540b78]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:31 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 Jul 07 17:57:31 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:31 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348" returned: 0 in 1.033s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:31 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348 Jul 07 17:57:31 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:32 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0ec636e6-d44d-4515-9eef-f86dbe566348" returned: 0 in 0.698s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-quobyte-0ec636e6-d44d-4515-9eef-f86dbe566348" released by "delete_volume" :: held 1.825s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Created reservations ['cc2e58d0-f160-4661-8f54-9c4a20056713', 'e4db6368-917a-4bbe-bc09-bbaf9e7b023d', '13a7f8b9-f7b4-4d2a-9746-635f0f278361', 'f13b2eec-e6b5-4219-9fab-8e1014a780b3'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:32 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:57:32 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:33 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.880s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:33 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Deleted volume successfully. Jul 07 17:57:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-70816bad-93d3-472e-97ac-bec0b77d9381 tempest-SnapshotsActionsTest-416303468 None] Lock "cinder-0ec636e6-d44d-4515-9eef-f86dbe566348-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2b4b192a-5bce-44c7-8450-007875e65419 req-61368c09-17d3-4812-ac59-4a1c225a4ca6 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2b4b192a-5bce-44c7-8450-007875e65419 req-61368c09-17d3-4812-ac59-4a1c225a4ca6 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:34 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5591ad5-a228-44a7-b643-043153a9aadd]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-2b4b192a-5bce-44c7-8450-007875e65419 req-61368c09-17d3-4812-ac59-4a1c225a4ca6 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:35 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 Jul 07 17:57:35 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Flow 'volume_create_manager' (6a8c9dff-28fe-48dd-8941-a7b8f52223bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8dc0dd-ec50-45b0-85e3-16522d05b2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8dc0dd-ec50-45b0-85e3-16522d05b2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-930605689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67a1710f869418ca81cd0c6988d0e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:35Z,use_quota=True,user_id='393af11e65a243eda99484ea42671cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb8a479-eb27-4964-a5fc-33f8dcc3b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb8a479-eb27-4964-a5fc-33f8dcc3b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095c56e4-3af8-413a-ab40-bcc8eff5fe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095c56e4-3af8-413a-ab40-bcc8eff5fe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2', 'volume_name': 'volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddc2060-f40c-4d89-9d46-d7e1670e1831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ddc2060-f40c-4d89-9d46-d7e1670e1831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fadbdf-3d5b-44a5-9518-194a2089868a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:35 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Volume a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Trying to clone a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 from image e34b77ca-f38c-49a7-885f-cd463a6fcc7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 17:57:35 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-2b4b192a-5bce-44c7-8450-007875e65419 req-61368c09-17d3-4812-ac59-4a1c225a4ca6 tempest-AttachVolumeTestJSON-357092893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181" returned: 0 in 0.989s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-2b4b192a-5bce-44c7-8450-007875e65419 req-61368c09-17d3-4812-ac59-4a1c225a4ca6 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.025s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2b4b192a-5bce-44c7-8450-007875e65419 req-61368c09-17d3-4812-ac59-4a1c225a4ca6 tempest-AttachVolumeTestJSON-357092893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4d2010a-5d90-4b97-81fe-84d025427ef1', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:57:36 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-2b4b192a-5bce-44c7-8450-007875e65419 req-61368c09-17d3-4812-ac59-4a1c225a4ca6 tempest-AttachVolumeTestJSON-357092893 None] attachment_update completed successfully. Jul 07 17:57:36 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:57:36 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:57:36 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71a6eb2-73a1-468f-9a50-25628f0761e3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:36 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD Jul 07 17:57:36 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:37 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD" returned: 0 in 0.935s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:37 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Temporary image e34b77ca-f38c-49a7-885f-cd463a6fcc7d is fetched for user 393af11e65a243eda99484ea42671cdd. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:57:37 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f13afb-bc7e-4923-bdcb-578f1d6e047f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:37 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD Jul 07 17:57:37 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:38 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-930605689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e67a1710f869418ca81cd0c6988d0e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:35Z,use_quota=True,user_id='393af11e65a243eda99484ea42671cdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Creating volume a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:38 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:38 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 1073741824 Jul 07 17:57:38 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:38 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Flow 'volume_create_manager' (a6c77aea-5204-4699-81e1-f0736b2176d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7985d7a0-8926-4a2d-9df3-941840283a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7985d7a0-8926-4a2d-9df3-941840283a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ec5760-e2c9-4fe7-bab8-e66a999e0bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa47c133ffa44ecb95c3014d8fdeeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:39Z,use_quota=True,user_id='b3d324405b20421b9afe34c3d061607a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b6ba818-4b51-441e-b7b5-dc8b9c59264f),volume_type_id=5b6ba818-4b51-441e-b7b5-dc8b9c59264f)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdfea36-f743-4bf5-8f0e-f0478fa3592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcdfea36-f743-4bf5-8f0e-f0478fa3592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5119d0da-6225-43c5-908b-eeedf1212903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:57:39 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 1073741824" returned: 0 in 1.041s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:39 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 Jul 07 17:57:39 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5119d0da-6225-43c5-908b-eeedf1212903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56ec5760-e2c9-4fe7-bab8-e66a999e0bd5', 'volume_name': 'volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5', 'volume_size': 1, 'image_id': 'ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '185ef376583e09492cb2157a3c96afd3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eaa47c133ffa44ecb95c3014d8fdeeba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab261e22b6d99124b1cd7d62d643775029157e17ecbc09af77498993523fdd9f6bd470f3a9c9b079796fd87b65fd4918df126d74332ccb37b27d0ace68fe93a3', 'id': 'ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'created_at': datetime.datetime(2026, 7, 7, 15, 57, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50017cd-02df-4732-897e-a379d9414038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50017cd-02df-4732-897e-a379d9414038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e62e06-b818-4092-bb1b-5027a46c026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:39 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Volume 56ec5760-e2c9-4fe7-bab8-e66a999e0bd5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5', 'volume_size': 1, 'image_id': 'ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '185ef376583e09492cb2157a3c96afd3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eaa47c133ffa44ecb95c3014d8fdeeba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab261e22b6d99124b1cd7d62d643775029157e17ecbc09af77498993523fdd9f6bd470f3a9c9b079796fd87b65fd4918df126d74332ccb37b27d0ace68fe93a3', 'id': 'ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'created_at': datetime.datetime(2026, 7, 7, 15, 57, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Trying to clone 56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 from image ff71969c-652e-45ca-bbc7-e6d8d9392c9b at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:57:39 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9fb572-b045-48e2-a810-9787bf289fe6]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:39 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD Jul 07 17:57:39 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:39 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" returned: 0 in 0.717s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:57:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:40 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Attempting download of e34b77ca-f38c-49a7-885f-cd463a6fcc7d ((None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}])) to volume a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:57:40 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8288370c-ef80-4fa0-9ced-13572c49974c]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_x15424gh {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:40 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_x15424gh Jul 07 17:57:40 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:40 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:40 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD Jul 07 17:57:40 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:41 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_x15424gh" returned: 0 in 0.862s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_x15424gh {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:41 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_x15424gh Jul 07 17:57:41 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:41 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD" returned: 1 in 0.888s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Temporary image ff71969c-652e-45ca-bbc7-e6d8d9392c9b is fetched for user b3d324405b20421b9afe34c3d061607a. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8250cfa2-2677-49e4-8e81-03d190ce123e]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:41 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD Jul 07 17:57:41 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Flow 'volume_create_manager' (9c6142da-623f-42cf-89f9-129c3211c07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f8ac7e-e168-46b6-a221-81ea91168902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f8ac7e-e168-46b6-a221-81ea91168902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-637183943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b5b94c-950c-4421-8b6f-8a53d9947cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972427dcb6d9477b87a46d5566dffa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:42Z,use_quota=True,user_id='e2151cd943894b74bf821245b6c1d9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e470e5c8-83f8-4058-b2fd-d6546565424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e470e5c8-83f8-4058-b2fd-d6546565424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7819c5-54d7-423c-8a53-143f75ace3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7819c5-54d7-423c-8a53-143f75ace3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b5b94c-950c-4421-8b6f-8a53d9947cf4', 'volume_name': 'volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95444b26-37eb-471e-93b8-f532cb0fc44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95444b26-37eb-471e-93b8-f532cb0fc44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d140907-5d2a-40db-b258-f789308a27ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:41 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Volume 90b5b94c-950c-4421-8b6f-8a53d9947cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4', 'volume_size': 1} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-637183943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b5b94c-950c-4421-8b6f-8a53d9947cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972427dcb6d9477b87a46d5566dffa34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:42Z,use_quota=True,user_id='e2151cd943894b74bf821245b6c1d9fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Creating volume 90b5b94c-950c-4421-8b6f-8a53d9947cf4 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:41 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:41 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_x15424gh" returned: 1 in 0.945s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_x15424gh' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dc74f9-3805-401f-b4ca-7180da5dcb6e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:41 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 1073741824 Jul 07 17:57:41 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:42 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD Jul 07 17:57:42 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:42 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:42 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD Jul 07 17:57:42 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:42 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD" returned: 0 in 0.963s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:42 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] e34b77ca-f38c-49a7-885f-cd463a6fcc7d was qcow2, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:57:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:42 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 Jul 07 17:57:42 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:43 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 1073741824" returned: 0 in 1.115s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:43 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 Jul 07 17:57:43 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:43 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD" returned: 1 in 0.865s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:43 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4" returned: 0 in 0.743s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.682s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ec5760-e2c9-4fe7-bab8-e66a999e0bd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaa47c133ffa44ecb95c3014d8fdeeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:39Z,use_quota=True,user_id='b3d324405b20421b9afe34c3d061607a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b6ba818-4b51-441e-b7b5-dc8b9c59264f),volume_type_id=5b6ba818-4b51-441e-b7b5-dc8b9c59264f)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Creating volume 56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:43 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d140907-5d2a-40db-b258-f789308a27ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:43 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 1073741824 Jul 07 17:57:43 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e2c9b7-7286-4d09-92fb-a51be98dfdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:43 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Volume volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 (90b5b94c-950c-4421-8b6f-8a53d9947cf4): created successfully Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e2c9b7-7286-4d09-92fb-a51be98dfdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Flow 'volume_create_manager' (9c6142da-623f-42cf-89f9-129c3211c07f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9ad226a1-6078-4e82-b2eb-55510cf9dc08 tempest-AttachVolumeTestJSON-357092893 None] Created volume successfully. Jul 07 17:57:44 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 1073741824" returned: 0 in 0.938s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:44 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 Jul 07 17:57:44 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:45 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" returned: 0 in 2.372s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_zjniboxwdevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:57:45 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Converted 112.00 MB image at 47.20 MB/s Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:45 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 1G Jul 07 17:57:45 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:45 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" returned: 0 in 0.831s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Attempting download of ff71969c-652e-45ca-bbc7-e6d8d9392c9b ((None, [{'url': 'file:///opt/stack/data/glance/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'metadata': {}}])) to volume 56ec5760-e2c9-4fe7-bab8-e66a999e0bd5. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa67992-a220-4187-ba2f-b3604d45d5a2]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_qpwtjijc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:45 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_qpwtjijc Jul 07 17:57:45 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:46 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 1G" returned: 0 in 0.734s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[468da280-7f01-4af9-aa85-60f8221a225a]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:46 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 Jul 07 17:57:46 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:46 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_qpwtjijc" returned: 0 in 0.813s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_qpwtjijc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:46 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_qpwtjijc Jul 07 17:57:46 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:46 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" returned: 0 in 0.847s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:47 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 Jul 07 17:57:47 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:47 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_qpwtjijc" returned: 1 in 0.835s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_qpwtjijc' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7135180-9a0d-4991-b24a-f632add45975]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:47 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD Jul 07 17:57:47 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:47 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" returned: 1 in 0.892s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Downloaded image e34b77ca-f38c-49a7-885f-cd463a6fcc7d ((None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}])) to volume a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Temporary image e34b77ca-f38c-49a7-885f-cd463a6fcc7d for user 393af11e65a243eda99484ea42671cdd is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Marking volume a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Copying metadata from image e34b77ca-f38c-49a7-885f-cd463a6fcc7d to a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Creating volume glance metadata for volume a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 backed by image e34b77ca-f38c-49a7-885f-cd463a6fcc7d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:57:47 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fadbdf-3d5b-44a5-9518-194a2089868a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa5a9ec-ea67-4769-8a4d-71e4f932884f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:48 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Volume volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 (a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2): created successfully Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caa5a9ec-ea67-4769-8a4d-71e4f932884f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Flow 'volume_create_manager' (6a8c9dff-28fe-48dd-8941-a7b8f52223bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1bff65c0-2059-4532-9d50-e5b64533f284 tempest-VolumesImageMetadata-1439795412 None] Created volume successfully. Jul 07 17:57:48 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-d89315b7-6a49-485e-a438-290736ba2f08 req-712d5228-8088-4eb1-8d38-35d11831a622 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-d89315b7-6a49-485e-a438-290736ba2f08 req-712d5228-8088-4eb1-8d38-35d11831a622 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaa0761-72c3-482b-9bab-437486a6ded8]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-d89315b7-6a49-485e-a438-290736ba2f08 req-712d5228-8088-4eb1-8d38-35d11831a622 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:48 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD Jul 07 17:57:48 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:48 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 Jul 07 17:57:48 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:49 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD" returned: 1 in 0.809s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] ff71969c-652e-45ca-bbc7-e6d8d9392c9b was raw, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:49 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 Jul 07 17:57:49 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:49 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-d89315b7-6a49-485e-a438-290736ba2f08 req-712d5228-8088-4eb1-8d38-35d11831a622 tempest-AttachVolumeTestJSON-357092893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4" returned: 0 in 0.925s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-d89315b7-6a49-485e-a438-290736ba2f08 req-712d5228-8088-4eb1-8d38-35d11831a622 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-d89315b7-6a49-485e-a438-290736ba2f08 req-712d5228-8088-4eb1-8d38-35d11831a622 tempest-AttachVolumeTestJSON-357092893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26752e3c-7401-41e4-b455-0dc3584462ce', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 17:57:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-d89315b7-6a49-485e-a438-290736ba2f08 req-712d5228-8088-4eb1-8d38-35d11831a622 tempest-AttachVolumeTestJSON-357092893 None] attachment_update completed successfully. Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Acquiring lock "cinder-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Lock "cinder-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Acquiring lock "cinder-quobyte-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Lock "cinder-quobyte-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e29707-a375-492e-abcb-920f8bf9d515]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:49 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 Jul 07 17:57:49 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:50 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" returned: 0 in 0.997s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:50 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff71969c-652e-45ca-bbc7-e6d8d9392c9b_bur675gxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:57:50 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:57:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:50 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 1G Jul 07 17:57:50 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:50 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" returned: 0 in 0.808s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:50 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 Jul 07 17:57:50 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:51 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 1G" returned: 0 in 0.880s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:51 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[066e3349-b902-41da-807a-84e4e74b4714]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:51 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 Jul 07 17:57:51 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:51 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" returned: 1 in 0.969s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:51 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2 Jul 07 17:57:51 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:52 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" returned: 0 in 0.929s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:52 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 Jul 07 17:57:52 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:52 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" returned: 0 in 0.798s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Lock "cinder-quobyte-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2" released by "delete_volume" :: held 2.667s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Created reservations ['bb5d6188-bfc6-4af5-a14d-ef9fe719d5d1', 'abe0878b-7d4f-4c77-884f-c444e6d9516f', '235c491b-dcbc-4fc3-acf3-29d7a1596809', 'd812e775-f42d-4559-a435-cfbda536d07a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:52 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:57:52 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:52 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" returned: 1 in 0.895s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Downloaded image ff71969c-652e-45ca-bbc7-e6d8d9392c9b ((None, [{'url': 'file:///opt/stack/data/glance/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'metadata': {}}])) to volume 56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Temporary image ff71969c-652e-45ca-bbc7-e6d8d9392c9b for user b3d324405b20421b9afe34c3d061607a is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Marking volume 56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Copying metadata from image ff71969c-652e-45ca-bbc7-e6d8d9392c9b to 56ec5760-e2c9-4fe7-bab8-e66a999e0bd5. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:57:52 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Creating volume glance metadata for volume 56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 backed by image ff71969c-652e-45ca-bbc7-e6d8d9392c9b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '185ef376583e09492cb2157a3c96afd3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e62e06-b818-4092-bb1b-5027a46c026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5', 'volume_size': 1, 'image_id': 'ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '185ef376583e09492cb2157a3c96afd3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'eaa47c133ffa44ecb95c3014d8fdeeba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab261e22b6d99124b1cd7d62d643775029157e17ecbc09af77498993523fdd9f6bd470f3a9c9b079796fd87b65fd4918df126d74332ccb37b27d0ace68fe93a3', 'id': 'ff71969c-652e-45ca-bbc7-e6d8d9392c9b', 'created_at': datetime.datetime(2026, 7, 7, 15, 57, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff71969c-652e-45ca-bbc7-e6d8d9392c9b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0bdec8-e898-4e93-bd8d-fa25157667b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:53 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Volume volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 (56ec5760-e2c9-4fe7-bab8-e66a999e0bd5): created successfully Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0bdec8-e898-4e93-bd8d-fa25157667b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Flow 'volume_create_manager' (a6c77aea-5204-4699-81e1-f0736b2176d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-21ca794c-e7b6-4f12-84c4-18a04a74b5bc tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Created volume successfully. Jul 07 17:57:53 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.768s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Deleted volume successfully. Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-683bd43b-8c11-430f-8dbb-971ca27df959 tempest-VolumesImageMetadata-1439795412 None] Lock "cinder-a9ecaaf2-b4d4-4eff-bd26-0cef8af4dfd2-delete_volume" released by "delete_volume" :: held 3.666s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (642777c1-6182-4d5d-80d8-863d073d7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e97a266-d81d-4573-b9e7-33a65656fac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e97a266-d81d-4573-b9e7-33a65656fac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-710879286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b9f42f-9c79-47ab-bb35-d9e14e4325e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:53Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a18b9be-b235-44b5-bf8d-4ef2c8f3a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a18b9be-b235-44b5-bf8d-4ef2c8f3a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e74678-157c-41b2-a8cd-f815d8cc0cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e74678-157c-41b2-a8cd-f815d8cc0cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b9f42f-9c79-47ab-bb35-d9e14e4325e2', 'volume_name': 'volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c317a4-3dc2-4b45-b16f-0a6920f9c2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c317a4-3dc2-4b45-b16f-0a6920f9c2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95257cb9-d172-4757-90eb-76c5dbe0b56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:53 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Volume 09b9f42f-9c79-47ab-bb35-d9e14e4325e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2', 'volume_size': 1} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-710879286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b9f42f-9c79-47ab-bb35-d9e14e4325e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:53Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Creating volume 09b9f42f-9c79-47ab-bb35-d9e14e4325e2 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:53 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:53 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 1073741824 Jul 07 17:57:53 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Acquiring lock "cinder-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "cinder-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Acquiring lock "cinder-quobyte-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:57:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "cinder-quobyte-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:57:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dec08c9-4633-4875-ae8d-41065c06c992]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:57:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:54 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 Jul 07 17:57:54 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:54 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 1073741824" returned: 0 in 1.138s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:54 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 Jul 07 17:57:54 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:55 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" returned: 0 in 0.855s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:55 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 Jul 07 17:57:55 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:55 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2" returned: 0 in 0.738s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95257cb9-d172-4757-90eb-76c5dbe0b56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6288f2b-8cbb-4823-ac61-1fb1be378eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:55 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Volume volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 (09b9f42f-9c79-47ab-bb35-d9e14e4325e2): created successfully Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6288f2b-8cbb-4823-ac61-1fb1be378eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (642777c1-6182-4d5d-80d8-863d073d7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1be2277c-5035-43a1-857d-8f81ac7b8d53 tempest-VolumesGetTest-1971740301 None] Created volume successfully. Jul 07 17:57:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-29799ec1-cb67-4a86-9f5d-120c82e824e5 req-0063781a-09b8-4d07-ac00-bc829c825784 tempest-AttachVolumeTestJSON-357092893 None] Terminate volume connection completed successfully. Jul 07 17:57:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-29799ec1-cb67-4a86-9f5d-120c82e824e5 req-0063781a-09b8-4d07-ac00-bc829c825784 tempest-AttachVolumeTestJSON-357092893 None] Deleting attachment b4d2010a-5d90-4b97-81fe-84d025427ef1. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:57:56 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" returned: 1 in 0.852s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:56 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5 Jul 07 17:57:56 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:56 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" returned: 0 in 0.751s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "cinder-quobyte-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5" released by "delete_volume" :: held 2.556s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:56 devstack cinder-volume[87228]: WARNING cinder.quota [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:57:56 devstack cinder-volume[87228]: WARNING cinder.quota [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Created reservations ['68ebc7f9-abeb-45ca-9eb0-bda8236e4477', '8021d52f-b535-4c44-9a6a-43abf63568db', '3eca1d2e-4a94-4f8e-afe8-f6dfdb065108', 'b81325f9-b518-4b17-a4d8-210ff89b4f7a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:56 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:57:56 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Flow 'volume_create_manager' (58290f15-1453-4548-8ab0-4469b5d8fd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114d33ac-73d4-4ec6-a820-4cfeacebc49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114d33ac-73d4-4ec6-a820-4cfeacebc49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1901812075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f904199-10ce-4fe5-901e-bc611ae9646b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7f5cd772d34d828f4ea55bbe856200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:58Z,use_quota=True,user_id='026e5fa1018d452eb97254cceee393aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ea70ff-328e-425d-b0d6-1f45ff6f909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ea70ff-328e-425d-b0d6-1f45ff6f909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25703a85-8502-4bb7-be07-47c9205b263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25703a85-8502-4bb7-be07-47c9205b263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f904199-10ce-4fe5-901e-bc611ae9646b', 'volume_name': 'volume-3f904199-10ce-4fe5-901e-bc611ae9646b', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d650dc6f-f3a7-4068-94e8-b15cab1c3cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d650dc6f-f3a7-4068-94e8-b15cab1c3cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc4b5ac-19c6-4252-ad1b-8e876e7b0c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:57 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Volume 3f904199-10ce-4fe5-901e-bc611ae9646b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f904199-10ce-4fe5-901e-bc611ae9646b', 'volume_size': 1} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:57 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1901812075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f904199-10ce-4fe5-901e-bc611ae9646b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f7f5cd772d34d828f4ea55bbe856200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:58Z,use_quota=True,user_id='026e5fa1018d452eb97254cceee393aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Creating volume 3f904199-10ce-4fe5-901e-bc611ae9646b {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:57 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.942s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:57:57 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b 1073741824 Jul 07 17:57:57 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (ff893f7b-5281-4f8a-a6ef-cacc80f11698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cf92de-1661-4ccc-8a97-ed303861b0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Deleted volume successfully. Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cf92de-1661-4ccc-8a97-ed303861b0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1164370103',display_name='tempest-VolumesGetTest-Volume-1553386892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfe9d07-8112-4428-85b9-bc801c339aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:58Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaff8e9d-530b-4ff5-b9a2-3d3947a473cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaff8e9d-530b-4ff5-b9a2-3d3947a473cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbb8176-b3a1-450c-9614-95ec42ab4449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbb8176-b3a1-450c-9614-95ec42ab4449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cfe9d07-8112-4428-85b9-bc801c339aea', 'volume_name': 'volume-3cfe9d07-8112-4428-85b9-bc801c339aea', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7fa836-7c99-4d21-89e1-0ce0a12e0fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7fa836-7c99-4d21-89e1-0ce0a12e0fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a55829-b054-40b6-bc98-76c8e2ab6a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:58 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Volume 3cfe9d07-8112-4428-85b9-bc801c339aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cfe9d07-8112-4428-85b9-bc801c339aea', 'volume_size': 1} Jul 07 17:57:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea22a83-ef2c-4e10-9395-d1f27ec7626c tempest-VolumeAndVolumeTypeFromImageTest-965420004 None] Lock "cinder-56ec5760-e2c9-4fe7-bab8-e66a999e0bd5-delete_volume" released by "delete_volume" :: held 3.873s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:57:58 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b 1073741824" returned: 0 in 0.983s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:58 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b Jul 07 17:57:58 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-a71f0639-98c8-424a-8c73-7b1cd9149598 req-a2b7540e-db12-4814-9cd5-bec9d3eb0a65 tempest-AttachVolumeTestJSON-357092893 None] Terminate volume connection completed successfully. Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-a71f0639-98c8-424a-8c73-7b1cd9149598 req-a2b7540e-db12-4814-9cd5-bec9d3eb0a65 tempest-AttachVolumeTestJSON-357092893 None] Deleting attachment 26752e3c-7401-41e4-b455-0dc3584462ce. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 17:57:59 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b" returned: 0 in 0.733s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.678s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:57:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1164370103',display_name='tempest-VolumesGetTest-Volume-1553386892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfe9d07-8112-4428-85b9-bc801c339aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:57:58Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Creating volume 3cfe9d07-8112-4428-85b9-bc801c339aea {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:57:59 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc4b5ac-19c6-4252-ad1b-8e876e7b0c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f904199-10ce-4fe5-901e-bc611ae9646b', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f981e79-9102-4952-a167-87b2e7f80d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:57:59 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea 1073741824 Jul 07 17:57:59 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:59 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Volume volume-3f904199-10ce-4fe5-901e-bc611ae9646b (3f904199-10ce-4fe5-901e-bc611ae9646b): created successfully Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f981e79-9102-4952-a167-87b2e7f80d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:57:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Flow 'volume_create_manager' (58290f15-1453-4548-8ab0-4469b5d8fd9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:57:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f0bb967f-9b3c-4d6b-8747-6f05bdc4fbe8 tempest-AbsoluteLimitsTests-828678162 None] Created volume successfully. Jul 07 17:58:00 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea 1073741824" returned: 0 in 1.044s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Acquiring lock "cinder-3f904199-10ce-4fe5-901e-bc611ae9646b-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Lock "cinder-3f904199-10ce-4fe5-901e-bc611ae9646b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:00 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea Jul 07 17:58:00 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Acquiring lock "cinder-quobyte-3f904199-10ce-4fe5-901e-bc611ae9646b" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Lock "cinder-quobyte-3f904199-10ce-4fe5-901e-bc611ae9646b" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6673d9-802b-4f3f-a1b8-e778aec3538e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:01 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b Jul 07 17:58:01 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:01 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea" returned: 0 in 0.753s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a55829-b054-40b6-bc98-76c8e2ab6a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfe9d07-8112-4428-85b9-bc801c339aea', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79168e41-5caf-4f17-8719-103c901cfc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:01 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Volume volume-3cfe9d07-8112-4428-85b9-bc801c339aea (3cfe9d07-8112-4428-85b9-bc801c339aea): created successfully Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79168e41-5caf-4f17-8719-103c901cfc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (ff893f7b-5281-4f8a-a6ef-cacc80f11698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:01 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-859e0405-c327-4112-959b-932ff61955dc tempest-VolumesGetTest-1971740301 None] Created volume successfully. Jul 07 17:58:01 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b" returned: 0 in 0.963s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:01 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b Jul 07 17:58:01 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-3cfe9d07-8112-4428-85b9-bc801c339aea-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Lock "cinder-3cfe9d07-8112-4428-85b9-bc801c339aea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-3cfe9d07-8112-4428-85b9-bc801c339aea" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-3cfe9d07-8112-4428-85b9-bc801c339aea" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486a615-f8d8-4901-8d9e-9542b669169a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:02 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea Jul 07 17:58:02 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:02 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f904199-10ce-4fe5-901e-bc611ae9646b" returned: 0 in 0.866s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Lock "cinder-quobyte-3f904199-10ce-4fe5-901e-bc611ae9646b" released by "delete_volume" :: held 1.880s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:02 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Created reservations ['2375e922-bee7-49b5-bc22-8610527b75c3', '59b7a050-e703-4d55-8197-17abeb8840e5', 'b6bea91e-ff00-4899-9aa9-579d0bcbbf1f', '71e149cf-fb0c-449d-b12e-63849c68a27f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (384233ee-707c-4a62-b3df-6e8dba81e999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bdc40c-0e03-44e3-a440-f40bed7dabfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bdc40c-0e03-44e3-a440-f40bed7dabfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392348531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c8e1f3-124f-4c64-82e7-77fa7e130510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:03Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68a8db0-ef1b-4836-a286-a8a74b39564b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68a8db0-ef1b-4836-a286-a8a74b39564b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693fff4a-0603-416e-87aa-3d96bf737a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (693fff4a-0603-416e-87aa-3d96bf737a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c8e1f3-124f-4c64-82e7-77fa7e130510', 'volume_name': 'volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b2cc36-73ca-4a98-9372-f425080160ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b2cc36-73ca-4a98-9372-f425080160ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63008c81-c668-410b-96d6-29c9d07d6322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Volume d0c8e1f3-124f-4c64-82e7-77fa7e130510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510', 'volume_size': 1} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-392348531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c8e1f3-124f-4c64-82e7-77fa7e130510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:03Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Creating volume d0c8e1f3-124f-4c64-82e7-77fa7e130510 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:03 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:03 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 1073741824 Jul 07 17:58:03 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:03 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:03 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:03 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea" returned: 0 in 1.111s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:03 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea Jul 07 17:58:03 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (aed2afd5-e191-4cee-ae0b-2c8eb18a0572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e87875a-399f-4947-ab8a-0044527b6ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e87875a-399f-4947-ab8a-0044527b6ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2118959006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23674458-e963-493d-b9a6-cef24ef18722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:03Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef96b674-7905-484d-8546-8fdd2cfe4374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef96b674-7905-484d-8546-8fdd2cfe4374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8c0cca-d9d0-4fed-b730-540263f820e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8c0cca-d9d0-4fed-b730-540263f820e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23674458-e963-493d-b9a6-cef24ef18722', 'volume_name': 'volume-23674458-e963-493d-b9a6-cef24ef18722', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec10ae3-7c98-456c-bccc-0d4fa1a0989f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec10ae3-7c98-456c-bccc-0d4fa1a0989f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871e28a7-169e-4dd7-ba41-14befc30f5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:03 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Volume 23674458-e963-493d-b9a6-cef24ef18722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23674458-e963-493d-b9a6-cef24ef18722', 'volume_size': 1} Jul 07 17:58:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:04 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.320s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Deleted volume successfully. Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-90fdfd97-9799-43bf-aa93-f8dc63e2fd04 tempest-AbsoluteLimitsTests-828678162 None] Lock "cinder-3f904199-10ce-4fe5-901e-bc611ae9646b-delete_volume" released by "delete_volume" :: held 3.766s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:04 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3cfe9d07-8112-4428-85b9-bc801c339aea" returned: 0 in 1.379s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-3cfe9d07-8112-4428-85b9-bc801c339aea" released by "delete_volume" :: held 2.562s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Created reservations ['143cf782-d282-433f-89ca-8107e000111f', '70fff16c-0938-472f-a3e9-619c7678ece4', 'afe4572b-58b7-48d2-873b-250b95416030', 'c21488b1-1b18-4f56-980c-93060752940a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (5e298635-a7f0-47fd-ae92-abd94bdf05d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d23f44-551b-4027-a5ec-9c37e788feff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d23f44-551b-4027-a5ec-9c37e788feff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1520344074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efac212-f08e-4451-a7e6-647f45e97312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:05Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84169478-ddf6-4682-b3d7-acb09f6ce412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84169478-ddf6-4682-b3d7-acb09f6ce412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f6d198-5d6a-406e-97c8-f64595530c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f6d198-5d6a-406e-97c8-f64595530c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efac212-f08e-4451-a7e6-647f45e97312', 'volume_name': 'volume-7efac212-f08e-4451-a7e6-647f45e97312', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfa63df-73ec-4017-a3d5-1928589d89fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cfa63df-73ec-4017-a3d5-1928589d89fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736cc32b-17d7-408f-872d-1259a9fb9f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:04 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Volume 7efac212-f08e-4451-a7e6-647f45e97312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efac212-f08e-4451-a7e6-647f45e97312', 'volume_size': 1} Jul 07 17:58:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:05 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:05 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:05 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 1073741824" returned: 0 in 2.070s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:05 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 Jul 07 17:58:05 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (7265fe80-3adf-4c00-9872-b0d4203235cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7f5e43-5c1d-497d-8d1b-a5cb8ee5a2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7f5e43-5c1d-497d-8d1b-a5cb8ee5a2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803363682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf555d5-208e-4b45-b02b-9cd66d05077c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:05Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a777eb-3031-45ae-b04a-4b70f1b29cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a777eb-3031-45ae-b04a-4b70f1b29cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27df5c68-c22a-4232-a4ca-969d71c57fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27df5c68-c22a-4232-a4ca-969d71c57fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf555d5-208e-4b45-b02b-9cd66d05077c', 'volume_name': 'volume-aaf555d5-208e-4b45-b02b-9cd66d05077c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc46afd-4dcf-408b-9d60-4ad4bb7ee838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc46afd-4dcf-408b-9d60-4ad4bb7ee838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d5f579-bc61-4b17-9681-5cddb17d7726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:05 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Volume aaf555d5-208e-4b45-b02b-9cd66d05077c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf555d5-208e-4b45-b02b-9cd66d05077c', 'volume_size': 1} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-09b9f42f-9c79-47ab-bb35-d9e14e4325e2-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Lock "cinder-09b9f42f-9c79-47ab-bb35-d9e14e4325e2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-09b9f42f-9c79-47ab-bb35-d9e14e4325e2" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-09b9f42f-9c79-47ab-bb35-d9e14e4325e2" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[052ba083-5b3a-4d2d-b74e-0b9452bd3e33]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:06 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (9f15b321-e9fb-4541-b31a-3cb6bad23dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd393238-0956-4e73-962f-0797c40eeb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.285s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:06 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Deleted volume successfully. Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd393238-0956-4e73-962f-0797c40eeb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-168818198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c455d839-c451-48f4-90ff-e0ec1259553e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:06Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd87109b-2699-49b7-9457-d551c5d61069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:06 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 Jul 07 17:58:06 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd87109b-2699-49b7-9457-d551c5d61069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae3e691-ba04-4256-9633-b62ec064d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae3e691-ba04-4256-9633-b62ec064d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c455d839-c451-48f4-90ff-e0ec1259553e', 'volume_name': 'volume-c455d839-c451-48f4-90ff-e0ec1259553e', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fb46c0-efa3-4351-a390-b913fc57f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fb46c0-efa3-4351-a390-b913fc57f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb055da-034a-4fd6-b638-6a2f40d928d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:06 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Volume c455d839-c451-48f4-90ff-e0ec1259553e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c455d839-c451-48f4-90ff-e0ec1259553e', 'volume_size': 1} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abefde9b-e119-4d45-81cf-dd5fe082c7c7 tempest-VolumesGetTest-1971740301 None] Lock "cinder-3cfe9d07-8112-4428-85b9-bc801c339aea-delete_volume" released by "delete_volume" :: held 4.409s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:06 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510" returned: 0 in 1.303s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] <== create_volume: return (3472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.478s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.662s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2118959006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23674458-e963-493d-b9a6-cef24ef18722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:03Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Creating volume 23674458-e963-493d-b9a6-cef24ef18722 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:06 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63008c81-c668-410b-96d6-29c9d07d6322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:06 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 1073741824 Jul 07 17:58:06 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4bfcd5-ff44-4d6d-b8a3-65aef3f6097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:06 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Volume volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 (d0c8e1f3-124f-4c64-82e7-77fa7e130510): created successfully Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4bfcd5-ff44-4d6d-b8a3-65aef3f6097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (384233ee-707c-4a62-b3df-6e8dba81e999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:06 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4526bc01-88a7-45a0-b9f9-20fdca4369f4 tempest-CreateVolumesFromImageTest-1553559114 None] Created volume successfully. Jul 07 17:58:07 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2" returned: 0 in 1.232s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:07 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2 Jul 07 17:58:07 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:07 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 1073741824" returned: 0 in 1.034s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:07 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=125,cinder:INSERT=37,cinder:UPDATE=116,cinder:DELETE=10 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:58:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:07 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 Jul 07 17:58:07 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:08 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-09b9f42f-9c79-47ab-bb35-d9e14e4325e2" returned: 0 in 0.870s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-09b9f42f-9c79-47ab-bb35-d9e14e4325e2" released by "delete_volume" :: held 2.190s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=136,cinder:SELECT=117,cinder:INSERT=42,cinder:DELETE=9 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Created reservations ['97dc23fd-4abf-4a67-8d1e-4ffa110573d0', '87204f30-fcc3-4717-82c5-75de709ff386', '866f1cf5-7aa5-42ca-b49a-ae1051a00080', '27095616-5f58-450b-8d4b-9b77050099c9'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:08 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:08 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:08 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722" returned: 0 in 0.865s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.642s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1520344074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efac212-f08e-4451-a7e6-647f45e97312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:05Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Creating volume 7efac212-f08e-4451-a7e6-647f45e97312 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:08 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871e28a7-169e-4dd7-ba41-14befc30f5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23674458-e963-493d-b9a6-cef24ef18722', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:08 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 1073741824 Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff2386c-a826-426f-b9ed-4bb49ddf7227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:08 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:08 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Volume volume-23674458-e963-493d-b9a6-cef24ef18722 (23674458-e963-493d-b9a6-cef24ef18722): created successfully Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff2386c-a826-426f-b9ed-4bb49ddf7227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (aed2afd5-e191-4cee-ae0b-2c8eb18a0572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d3f0e313-6e4b-4419-8300-75a508957619 tempest-CreateVolumesFromImageTest-1553559114 None] Created volume successfully. Jul 07 17:58:09 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.807s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:09 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Deleted volume successfully. Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b93b30dc-6bb5-439e-b400-a2dd37f603a4 tempest-VolumesGetTest-1971740301 None] Lock "cinder-09b9f42f-9c79-47ab-bb35-d9e14e4325e2-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:09 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 1073741824" returned: 0 in 1.075s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:09 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 Jul 07 17:58:09 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (fb5c7099-09d5-44c1-b279-30ca0386ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ae350a-a610-47dc-8e2a-bac7e4ace475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ae350a-a610-47dc-8e2a-bac7e4ace475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1946968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cb9164-4820-4171-a8b4-9308492d42fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:10Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e26f58b-e30f-4cc9-a76e-d2439e8d0baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e26f58b-e30f-4cc9-a76e-d2439e8d0baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40627ccb-4942-4e11-8151-39243e225e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40627ccb-4942-4e11-8151-39243e225e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0cb9164-4820-4171-a8b4-9308492d42fe', 'volume_name': 'volume-e0cb9164-4820-4171-a8b4-9308492d42fe', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f875d2-09e5-4870-94ac-5ed04246c9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f875d2-09e5-4870-94ac-5ed04246c9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d620f6a4-3c71-4761-80ae-8af9917b21d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:09 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Volume e0cb9164-4820-4171-a8b4-9308492d42fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0cb9164-4820-4171-a8b4-9308492d42fe', 'volume_size': 1} Jul 07 17:58:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:10 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312" returned: 0 in 0.693s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.611s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803363682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf555d5-208e-4b45-b02b-9cd66d05077c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:05Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Creating volume aaf555d5-208e-4b45-b02b-9cd66d05077c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:10 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736cc32b-17d7-408f-872d-1259a9fb9f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efac212-f08e-4451-a7e6-647f45e97312', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:10 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c 1073741824 Jul 07 17:58:10 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f374c4b7-3793-4822-85f6-f54f9b69eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:10 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Volume volume-7efac212-f08e-4451-a7e6-647f45e97312 (7efac212-f08e-4451-a7e6-647f45e97312): created successfully Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f374c4b7-3793-4822-85f6-f54f9b69eb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (5e298635-a7f0-47fd-ae92-abd94bdf05d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9b1a0428-b9c8-42f7-b6ae-f7dfcc740f9d tempest-CreateVolumesFromImageTest-1553559114 None] Created volume successfully. Jul 07 17:58:11 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "cinder-90b5b94c-950c-4421-8b6f-8a53d9947cf4-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c 1073741824" returned: 0 in 0.986s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-90b5b94c-950c-4421-8b6f-8a53d9947cf4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "cinder-quobyte-90b5b94c-950c-4421-8b6f-8a53d9947cf4" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:11 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c Jul 07 17:58:11 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-quobyte-90b5b94c-950c-4421-8b6f-8a53d9947cf4" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0ef23-f5de-4be2-a5b7-fa04a3c79d95]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:11 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 Jul 07 17:58:11 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Flow 'volume_create_manager' (b2d7f318-3cac-4042-a40d-551a5bed4829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6e46e7-1ec0-46c0-8d8c-a32c53e8e63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6e46e7-1ec0-46c0-8d8c-a32c53e8e63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1302533545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385feeaa-b318-4e24-9d09-09eef5144974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731aebf43eb542a086b663ed5a7c0729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:12Z,use_quota=True,user_id='4a2361102c0e48bab4ca2b5fc7cd8f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0261e900-5bbd-47b1-b223-5c8469a41fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0261e900-5bbd-47b1-b223-5c8469a41fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8204a07-2a46-49f4-9ec4-7e7ddb5b9c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8204a07-2a46-49f4-9ec4-7e7ddb5b9c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '385feeaa-b318-4e24-9d09-09eef5144974', 'volume_name': 'volume-385feeaa-b318-4e24-9d09-09eef5144974', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d528b098-8965-4191-8ae7-f76b65eab8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d528b098-8965-4191-8ae7-f76b65eab8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842a4341-4559-445b-8149-34cb0913fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:12 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Volume 385feeaa-b318-4e24-9d09-09eef5144974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-385feeaa-b318-4e24-9d09-09eef5144974', 'volume_size': 1} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:12 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c" returned: 0 in 0.790s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.862s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-168818198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c455d839-c451-48f4-90ff-e0ec1259553e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ac45e234ef4d0baac69545d8b5afa9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:06Z,use_quota=True,user_id='66281dd7fe9c40999db77810e4fdb8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Creating volume c455d839-c451-48f4-90ff-e0ec1259553e {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:12 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:12 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e 1073741824 Jul 07 17:58:12 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74d5f579-bc61-4b17-9681-5cddb17d7726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf555d5-208e-4b45-b02b-9cd66d05077c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81797e3-afc9-4e10-abe1-640fd85e415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:12 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Volume volume-aaf555d5-208e-4b45-b02b-9cd66d05077c (aaf555d5-208e-4b45-b02b-9cd66d05077c): created successfully Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81797e3-afc9-4e10-abe1-640fd85e415f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (7265fe80-3adf-4c00-9872-b0d4203235cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:12 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-073bde50-5375-4a46-9a60-5afcbe7723d9 tempest-CreateVolumesFromImageTest-1553559114 None] Created volume successfully. Jul 07 17:58:12 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4" returned: 0 in 0.845s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:12 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4 Jul 07 17:58:12 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:13 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-90b5b94c-950c-4421-8b6f-8a53d9947cf4" returned: 0 in 0.659s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-quobyte-90b5b94c-950c-4421-8b6f-8a53d9947cf4" released by "delete_volume" :: held 1.553s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Created reservations ['c08a5120-e8aa-4a53-8409-288cd31b567c', '054ce787-90fd-4308-b7c2-1e44524efcf0', 'b0837629-9d5b-4da3-a57e-1311c5e21876', 'c577cdfd-3703-47fc-87b5-8b43899b23cd'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:13 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e 1073741824" returned: 0 in 0.872s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:13 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e Jul 07 17:58:13 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:13 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:13 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "cinder-a28a1c0f-2b17-4ee6-9793-dac9ab13c181-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-a28a1c0f-2b17-4ee6-9793-dac9ab13c181-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "cinder-quobyte-a28a1c0f-2b17-4ee6-9793-dac9ab13c181" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-quobyte-a28a1c0f-2b17-4ee6-9793-dac9ab13c181" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[360452ea-354d-4aa7-8ce4-a859c3413979]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:13 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e" returned: 0 in 0.641s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1946968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cb9164-4820-4171-a8b4-9308492d42fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:10Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Creating volume e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:13 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:13 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 Jul 07 17:58:13 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:13 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe 1073741824 Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb055da-034a-4fd6-b638-6a2f40d928d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c455d839-c451-48f4-90ff-e0ec1259553e', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:13 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a12f30-1c27-4162-af42-85a72ae4c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:13 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Volume volume-c455d839-c451-48f4-90ff-e0ec1259553e (c455d839-c451-48f4-90ff-e0ec1259553e): created successfully Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a12f30-1c27-4162-af42-85a72ae4c838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:13 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Flow 'volume_create_manager' (9f15b321-e9fb-4541-b31a-3cb6bad23dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.728s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:13 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:13 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Deleted volume successfully. Jul 07 17:58:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6060f03c-bb37-406c-9471-b89254f4d8ce tempest-CreateVolumesFromImageTest-1553559114 None] Created volume successfully. Jul 07 17:58:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-58b50b5b-532b-4583-9315-c72081e3181c tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-90b5b94c-950c-4421-8b6f-8a53d9947cf4-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:14 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181" returned: 0 in 0.774s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:14 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181 Jul 07 17:58:14 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:14 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe 1073741824" returned: 0 in 0.915s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:14 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe Jul 07 17:58:14 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-c455d839-c451-48f4-90ff-e0ec1259553e-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-c455d839-c451-48f4-90ff-e0ec1259553e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-quobyte-c455d839-c451-48f4-90ff-e0ec1259553e" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-c455d839-c451-48f4-90ff-e0ec1259553e" acquired by "delete_volume" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c063db-7dfe-4cb6-94d6-506d9f058d56]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:15 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a28a1c0f-2b17-4ee6-9793-dac9ab13c181" returned: 0 in 0.723s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-quobyte-a28a1c0f-2b17-4ee6-9793-dac9ab13c181" released by "delete_volume" :: held 1.545s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:15 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e Jul 07 17:58:15 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Created reservations ['2d0d71ad-c2d4-4b19-be00-76323c597a04', '30053245-a34a-42ca-93cb-9c784597c24f', 'eeeb6742-7802-4791-952f-b1db3ad6c7c8', '76f9a9e1-f5ed-4a09-820b-54593f758602'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:15 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:15 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:15 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe" returned: 0 in 0.707s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.510s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1302533545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=385feeaa-b318-4e24-9d09-09eef5144974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731aebf43eb542a086b663ed5a7c0729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:12Z,use_quota=True,user_id='4a2361102c0e48bab4ca2b5fc7cd8f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Creating volume 385feeaa-b318-4e24-9d09-09eef5144974 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:15 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:15 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 1073741824 Jul 07 17:58:15 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d620f6a4-3c71-4761-80ae-8af9917b21d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0cb9164-4820-4171-a8b4-9308492d42fe', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6122e146-7415-49f6-89c8-1ef0917cba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Volume volume-e0cb9164-4820-4171-a8b4-9308492d42fe (e0cb9164-4820-4171-a8b4-9308492d42fe): created successfully Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6122e146-7415-49f6-89c8-1ef0917cba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (fb5c7099-09d5-44c1-b279-30ca0386ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:15 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-032a38fa-937d-478a-a627-8ce577d8836c tempest-VolumesGetTest-1971740301 None] Created volume successfully. Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "cinder-d621008a-ae87-444e-ad9c-e9c7914f4b97-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-d621008a-ae87-444e-ad9c-e9c7914f4b97-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "cinder-quobyte-d621008a-ae87-444e-ad9c-e9c7914f4b97" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:16 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.701s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:16 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-quobyte-d621008a-ae87-444e-ad9c-e9c7914f4b97" acquired by "delete_volume" :: waited 0.048s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Deleted volume successfully. Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e" returned: 0 in 0.993s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d15e63e-0d3b-4ad5-b563-83fc9627d920]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bb930dd2-d00c-47de-a07b-64900d3fe437 tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-a28a1c0f-2b17-4ee6-9793-dac9ab13c181-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:16 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e Jul 07 17:58:16 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:16 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 Jul 07 17:58:16 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:16 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 1073741824" returned: 0 in 1.117s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:16 devstack sudo[98393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 Jul 07 17:58:16 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (a3f9b982-b8f7-447f-aa2f-ebd776c48db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8399c23-afcb-48a1-a3eb-8bfd863b2650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8399c23-afcb-48a1-a3eb-8bfd863b2650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1629640366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a60599f-4e74-4dba-a7d6-d7b284ef438e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e0cb9164-4820-4171-a8b4-9308492d42fe,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:17Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7737efd-f4f9-46b0-80c7-0eadac425293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7737efd-f4f9-46b0-80c7-0eadac425293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c92ef22-831c-4986-a078-e853dae84309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c92ef22-831c-4986-a078-e853dae84309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3a60599f-4e74-4dba-a7d6-d7b284ef438e', 'volume_name': 'volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e', 'volume_size': 1, 'source_volid': 'e0cb9164-4820-4171-a8b4-9308492d42fe', 'source_volstatus': 'available'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a541b99-8476-4885-8897-c92de936ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a541b99-8476-4885-8897-c92de936ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70925cc7-d81f-45d6-9c91-cd8c6bf8dc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:17 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Volume 3a60599f-4e74-4dba-a7d6-d7b284ef438e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e', 'volume_size': 1, 'source_volid': 'e0cb9164-4820-4171-a8b4-9308492d42fe', 'source_volstatus': 'available'} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:17 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c455d839-c451-48f4-90ff-e0ec1259553e" returned: 0 in 0.837s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-c455d839-c451-48f4-90ff-e0ec1259553e" released by "delete_volume" :: held 1.880s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Created reservations ['eb9f4609-cf6c-419a-9697-c79f563e719e', '90a680ea-5950-4c44-94b8-f369f69ef981', 'cec3323c-a4d9-42c1-8c0f-544f61346b64', 'aebd2fcd-68a3-4242-a4a6-3436303fe786'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:17 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97" returned: 0 in 0.916s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:17 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97 Jul 07 17:58:17 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:17 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:17 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-aaf555d5-208e-4b45-b02b-9cd66d05077c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-aaf555d5-208e-4b45-b02b-9cd66d05077c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-quobyte-aaf555d5-208e-4b45-b02b-9cd66d05077c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-aaf555d5-208e-4b45-b02b-9cd66d05077c" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7ea0dd-d8e4-4795-a291-8b6658385382]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:17 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974" returned: 0 in 0.870s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.589s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:17 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Cloning volume e0cb9164-4820-4171-a8b4-9308492d42fe to volume 3a60599f-4e74-4dba-a7d6-d7b284ef438e Jul 07 17:58:17 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842a4341-4559-445b-8149-34cb0913fe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-385feeaa-b318-4e24-9d09-09eef5144974', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:17 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928f54db-9dac-41ef-8c17-85104bbd51ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:17 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Volume volume-385feeaa-b318-4e24-9d09-09eef5144974 (385feeaa-b318-4e24-9d09-09eef5144974): created successfully Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928f54db-9dac-41ef-8c17-85104bbd51ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Flow 'volume_create_manager' (b2d7f318-3cac-4042-a40d-551a5bed4829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Creating offline snapshot f8deac45-12c8-4fbf-8d08-a76d40d38645 of volume e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:58:17 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d23b8e02-aeb4-44f4-b258-720842bbe41d tempest-VolumesTransfersV357Test-1977851425 None] Created volume successfully. Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f6d92-3381-446a-b164-e76db6ef736a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:17 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d621008a-ae87-444e-ad9c-e9c7914f4b97" returned: 0 in 0.786s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:17 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe Jul 07 17:58:17 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-quobyte-d621008a-ae87-444e-ad9c-e9c7914f4b97" released by "delete_volume" :: held 1.786s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:17 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.800s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:17 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:18 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Deleted volume successfully. Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Created reservations ['1f115e78-26cb-492d-addb-13aad8b02023', '9b5694e8-f3a6-4fc5-be0d-8534d134333c', 'ced71640-274d-48ce-95f5-92303f841c05', 'cf048b99-2b7b-43b7-9fc9-dd6044db4bd0'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fde8f819-5c57-4b36-8f37-44f0a3c03812 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-c455d839-c451-48f4-90ff-e0ec1259553e-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:18 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:18 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:18 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c" returned: 0 in 0.944s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:18 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c Jul 07 17:58:18 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:18 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.835s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:18 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:18 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Deleted volume successfully. Jul 07 17:58:18 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe" returned: 0 in 1.264s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f0d842a8-7c1e-4c72-829a-6e7c4fbab23e tempest-AttachVolumeTestJSON-357092893 None] Lock "cinder-d621008a-ae87-444e-ad9c-e9c7914f4b97-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:19 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 1G Jul 07 17:58:19 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:19 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aaf555d5-208e-4b45-b02b-9cd66d05077c" returned: 0 in 0.909s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6096dea9-3a0f-4bf3-a68b-3d82d4cfa558 tempest-VolumesTransfersV357Test-374656096 None] Transfer volume completed successfully. Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-aaf555d5-208e-4b45-b02b-9cd66d05077c" released by "delete_volume" :: held 1.916s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Created reservations ['49b8149e-4de8-42ca-83a2-5cdfa6f08d6a', '4334e6c1-004e-4748-a98b-c94362650bfc', '7a5f41c6-4ab0-46c3-9bf4-e9446af26eec', 'cdf8c480-f1ca-489b-a5e0-719f7cf34a9a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:19 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:19 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-7efac212-f08e-4451-a7e6-647f45e97312-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-7efac212-f08e-4451-a7e6-647f45e97312-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-quobyte-7efac212-f08e-4451-a7e6-647f45e97312" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-7efac212-f08e-4451-a7e6-647f45e97312" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af90e3d-e1ac-46ce-a755-4b53e220e344]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:20 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 1G" returned: 0 in 1.162s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:20 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0cb9164-4820-4171-a8b4-9308492d42fe -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:20 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:20 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0cb9164-4820-4171-a8b4-9308492d42fe -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 Jul 07 17:58:20 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:20 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.897s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Deleted volume successfully. Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cf09b15e-4ee0-49c7-b328-1e177e12fc1a tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-aaf555d5-208e-4b45-b02b-9cd66d05077c-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Acquiring lock "cinder-385feeaa-b318-4e24-9d09-09eef5144974-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Lock "cinder-385feeaa-b318-4e24-9d09-09eef5144974-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Acquiring lock "cinder-quobyte-385feeaa-b318-4e24-9d09-09eef5144974" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Lock "cinder-quobyte-385feeaa-b318-4e24-9d09-09eef5144974" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a36a4d1-ee0c-4ac9-9176-5e8dfaaf9106]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:20 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 Jul 07 17:58:20 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:20 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312" returned: 0 in 1.022s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:21 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312 Jul 07 17:58:21 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:21 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0cb9164-4820-4171-a8b4-9308492d42fe -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645" returned: 0 in 1.017s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:21 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 is being set with open permissions: ugo+rw Jul 07 17:58:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:21 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 Jul 07 17:58:21 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:21 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974" returned: 0 in 1.025s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:21 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7efac212-f08e-4451-a7e6-647f45e97312" returned: 0 in 0.837s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:21 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974 Jul 07 17:58:21 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-7efac212-f08e-4451-a7e6-647f45e97312" released by "delete_volume" :: held 1.938s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:21 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Created reservations ['77fa3b65-358f-452c-848a-0ff7889cef13', '1cc67d99-14b9-4ab8-aa3b-5dbd43ced1bd', 'cbebe1a9-ba34-4245-8921-19db3ef00595', 'f66bca13-9b07-492a-9549-72eac8f41e2b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:21 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645" returned: 0 in 0.780s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:22 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.info Jul 07 17:58:22 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-23674458-e963-493d-b9a6-cef24ef18722-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:22 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:22 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-23674458-e963-493d-b9a6-cef24ef18722-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-quobyte-23674458-e963-493d-b9a6-cef24ef18722" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-23674458-e963-493d-b9a6-cef24ef18722" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[31432439-55cb-49d0-9c29-12d89a9a9a32]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:22 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 Jul 07 17:58:22 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:22 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.info" returned: 0 in 0.892s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:22 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.info is being set with open permissions: ugo+rw Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:22 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.info Jul 07 17:58:22 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:22 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-385feeaa-b318-4e24-9d09-09eef5144974" returned: 0 in 1.207s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Lock "cinder-quobyte-385feeaa-b318-4e24-9d09-09eef5144974" released by "delete_volume" :: held 2.290s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Created reservations ['3e9b1d3d-1ec2-4046-874f-d9744263e7b9', '84e07b95-2c09-48b7-b8ed-a40fa61045cf', '38965ac4-6822-4e84-8059-58d1809a48c9', '6ac929d6-8aeb-48e4-8bd2-bd964e6a3a4f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:23 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.253s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Deleted volume successfully. Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:23 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:23 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:23 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722" returned: 0 in 1.131s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a0b56b13-b134-4623-a7f7-87bc26e05b46 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-7efac212-f08e-4451-a7e6-647f45e97312-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:23 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722 Jul 07 17:58:23 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:23 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:23 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:23 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.info" returned: 0 in 1.074s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-3a60599f-4e74-4dba-a7d6-d7b284ef438e" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-3a60599f-4e74-4dba-a7d6-d7b284ef438e" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] snapshot: f8deac45-12c8-4fbf-8d08-a76d40d38645, volume: 3a60599f-4e74-4dba-a7d6-d7b284ef438e, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3765a7-000e-46e4-b3ed-f0d11bdfd941]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:24 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.971s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Deleted volume successfully. Jul 07 17:58:24 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 Jul 07 17:58:24 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1fef3a2d-8838-4d3c-8824-c9de343f012c tempest-VolumesTransfersV357Test-1375828743 None] Lock "cinder-385feeaa-b318-4e24-9d09-09eef5144974-delete_volume" released by "delete_volume" :: held 3.817s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:24 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23674458-e963-493d-b9a6-cef24ef18722" returned: 0 in 1.066s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-23674458-e963-493d-b9a6-cef24ef18722" released by "delete_volume" :: held 2.309s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Created reservations ['13685823-187b-44fc-895c-0189668dd399', '6d6ce003-d8a0-4564-b9d9-5fc38dffa0c6', '7970d338-dff2-43d2-bea6-ce206bb7d2a8', '91cf59cb-26bf-4f9a-a79e-c19937ac335f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:24 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:24 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:24 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.174s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:58:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Flow 'volume_create_manager' (f864e9f6-6f9a-47b2-97ee-9fd93ef6723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d3f3d8-7fce-4e4f-937a-18483dc4d816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d3f3d8-7fce-4e4f-937a-18483dc4d816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-918134385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8049f151-eaa8-4179-bae1-970f4dd12b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731aebf43eb542a086b663ed5a7c0729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:25Z,use_quota=True,user_id='4a2361102c0e48bab4ca2b5fc7cd8f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e33577-a51c-4e3a-9bda-429117718fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e33577-a51c-4e3a-9bda-429117718fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41615de9-c823-44e0-b543-da00f8f79ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41615de9-c823-44e0-b543-da00f8f79ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8049f151-eaa8-4179-bae1-970f4dd12b8f', 'volume_name': 'volume-8049f151-eaa8-4179-bae1-970f4dd12b8f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ccc402-4714-48b5-8fbe-c9b00f72f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57ccc402-4714-48b5-8fbe-c9b00f72f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ae1782-af03-4950-8cb1-abf7b0090cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:25 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Volume 8049f151-eaa8-4179-bae1-970f4dd12b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8049f151-eaa8-4179-bae1-970f4dd12b8f', 'volume_size': 1} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:25 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645" returned: 0 in 1.205s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0cb9164-4820-4171-a8b4-9308492d42fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ef5fb-5f01-4396-9e18-4e875d607427]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:25 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe Jul 07 17:58:25 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:25 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.798s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Deleted volume successfully. Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9152744b-476f-49cb-bdef-bd46ee4e3bf0 tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-23674458-e963-493d-b9a6-cef24ef18722-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-d0c8e1f3-124f-4c64-82e7-77fa7e130510-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-d0c8e1f3-124f-4c64-82e7-77fa7e130510-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "cinder-quobyte-d0c8e1f3-124f-4c64-82e7-77fa7e130510" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-d0c8e1f3-124f-4c64-82e7-77fa7e130510" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c8e862-3ddc-4066-9310-4085b7527950]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:25 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 Jul 07 17:58:25 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:26 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe" returned: 0 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:26 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 17:58:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:26 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e Jul 07 17:58:26 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:26 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510" returned: 0 in 0.871s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:26 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510 Jul 07 17:58:26 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:27 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d0c8e1f3-124f-4c64-82e7-77fa7e130510" returned: 0 in 0.821s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-quobyte-d0c8e1f3-124f-4c64-82e7-77fa7e130510" released by "delete_volume" :: held 1.762s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Created reservations ['314787d3-e9e2-4347-8557-7ccb4c571419', '0c546130-006e-443d-be42-175d4eec417b', '245d4a93-84e8-49ab-9be4-8b3e4f304a67', '3c8f3aad-ed7d-4785-ac68-247a611396fc'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:27 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:27 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:30 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 2.195s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:30 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Deleted volume successfully. Jul 07 17:58:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d2c265ed-47bb-45cf-bb96-cbf4efcdf94c tempest-CreateVolumesFromImageTest-1553559114 None] Lock "cinder-d0c8e1f3-124f-4c64-82e7-77fa7e130510-delete_volume" released by "delete_volume" :: held 4.382s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:32 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e" returned: 0 in 6.239s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bad8fa-1d48-4845-b3c0-22f545a4bd92]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:32 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe Jul 07 17:58:32 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:33 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe" returned: 0 in 1.021s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:33 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:58:33 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Converted 1024.00 MB image at 164.10 MB/s Jul 07 17:58:33 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e is being set with open permissions: ugo+rw Jul 07 17:58:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:33 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e Jul 07 17:58:33 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:34 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e" returned: 0 in 0.904s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-3a60599f-4e74-4dba-a7d6-d7b284ef438e" released by "_copy_volume_from_snapshot" :: held 10.409s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-f8deac45-12c8-4fbf-8d08-a76d40d38645" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-f8deac45-12c8-4fbf-8d08-a76d40d38645" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Deleting offline snapshot f8deac45-12c8-4fbf-8d08-a76d40d38645 of volume e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:58:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] snapshot_file for this snap is: volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:58:34 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f931995-b658-4e68-9820-effad0e3039f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:34 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 Jul 07 17:58:34 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:35 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645" returned: 0 in 0.853s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0cb9164-4820-4171-a8b4-9308492d42fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:58:35 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c25ed00-f2e8-4c88-a482-67f488ee3845]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:35 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe Jul 07 17:58:35 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:36 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe" returned: 0 in 0.857s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:36 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 Jul 07 17:58:36 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:37 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645" returned: 0 in 0.809s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:37 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645 Jul 07 17:58:37 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Flow 'volume_create_manager' (1173a6a3-ee67-4a42-b056-ca32dd2c6ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a569a6f-93f0-4e31-bb5f-1771277c26ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a569a6f-93f0-4e31-bb5f-1771277c26ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3669da-21e3-4d74-b134-0f798c8f672a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b60cf82b084f97b415f92e4774e10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:37Z,use_quota=True,user_id='e37573d4d34d4ff38d99f6b30eef22d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea9b467-c2d4-41d5-a942-7dc4ad17a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea9b467-c2d4-41d5-a942-7dc4ad17a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f28f5c-7968-45ae-8f89-8f0197e0fe89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f28f5c-7968-45ae-8f89-8f0197e0fe89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3d3669da-21e3-4d74-b134-0f798c8f672a', 'volume_name': 'volume-3d3669da-21e3-4d74-b134-0f798c8f672a', 'volume_size': 1, 'image_id': '9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebf0cc9aff5a474f7058264ee6cac170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23b60cf82b084f97b415f92e4774e10e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f99a6c78607c8b8ea7c2104d7a233dc9b3defee6117b51572da2340195770046bb4a93fb8a40d2c328aeaabf2d2b9021559d4c3ebddf02ebe455fc5c8fd6d001', 'id': '9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'created_at': datetime.datetime(2026, 7, 7, 15, 58, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f/file', 'properties': {}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27ae520-672d-4097-b590-523c38de39eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27ae520-672d-4097-b590-523c38de39eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253d5c5e-e5cf-4dbe-b668-bf77c19c0cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:37 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Volume 3d3669da-21e3-4d74-b134-0f798c8f672a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3d3669da-21e3-4d74-b134-0f798c8f672a', 'volume_size': 1, 'image_id': '9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebf0cc9aff5a474f7058264ee6cac170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23b60cf82b084f97b415f92e4774e10e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f99a6c78607c8b8ea7c2104d7a233dc9b3defee6117b51572da2340195770046bb4a93fb8a40d2c328aeaabf2d2b9021559d4c3ebddf02ebe455fc5c8fd6d001', 'id': '9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'created_at': datetime.datetime(2026, 7, 7, 15, 58, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f/file', 'properties': {}}, 'image_service': } Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Trying to clone 3d3669da-21e3-4d74-b134-0f798c8f672a from image 9b8ece32-2bcf-433b-9723-da94d1c7a26f at location (None, [{'url': 'file:///opt/stack/data/glance/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 17:58:37 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe.f8deac45-12c8-4fbf-8d08-a76d40d38645" returned: 0 in 0.682s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:58:37 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Image download 0.00 MB at 0.00 MB/s Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-f8deac45-12c8-4fbf-8d08-a76d40d38645" released by "_delete_snapshot" :: held 3.322s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d10142e-0b72-4bea-8d94-1f6f2fbc510a]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.286s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.683s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-918134385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8049f151-eaa8-4179-bae1-970f4dd12b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731aebf43eb542a086b663ed5a7c0729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:25Z,use_quota=True,user_id='4a2361102c0e48bab4ca2b5fc7cd8f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Creating volume 8049f151-eaa8-4179-bae1-970f4dd12b8f {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:37 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:37 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f 1073741824 Jul 07 17:58:37 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70925cc7-d81f-45d6-9c91-cd8c6bf8dc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e', 'volume_size': 1, 'source_volid': 'e0cb9164-4820-4171-a8b4-9308492d42fe', 'source_volstatus': 'available'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d7b144-c274-45bf-a08d-7839fb2204de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:38 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Volume volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e (3a60599f-4e74-4dba-a7d6-d7b284ef438e): created successfully Jul 07 17:58:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d7b144-c274-45bf-a08d-7839fb2204de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (a3f9b982-b8f7-447f-aa2f-ebd776c48db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:38 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD Jul 07 17:58:38 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-21ed542e-c16a-4ed1-a244-c5b02c15ea13 tempest-VolumesGetTest-1971740301 None] Created volume successfully. Jul 07 17:58:38 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:38 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD" returned: 0 in 0.835s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:38 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD Jul 07 17:58:38 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:38 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f 1073741824" returned: 0 in 0.956s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:38 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f Jul 07 17:58:38 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:39 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD" returned: 1 in 0.772s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Temporary image 9b8ece32-2bcf-433b-9723-da94d1c7a26f is fetched for user e37573d4d34d4ff38d99f6b30eef22d6. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f22f209-8ea6-460d-a55a-583c56641b6d]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:39 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f" returned: 0 in 0.698s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ae1782-af03-4950-8cb1-abf7b0090cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8049f151-eaa8-4179-bae1-970f4dd12b8f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2772debb-4e63-48c9-84a1-7db8a6acb86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:39 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Volume volume-8049f151-eaa8-4179-bae1-970f4dd12b8f (8049f151-eaa8-4179-bae1-970f4dd12b8f): created successfully Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2772debb-4e63-48c9-84a1-7db8a6acb86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Flow 'volume_create_manager' (f864e9f6-6f9a-47b2-97ee-9fd93ef6723d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:39 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c56984b7-c441-443f-9b47-8a580c06a465 tempest-VolumesTransfersV357Test-1977851425 None] Created volume successfully. Jul 07 17:58:39 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD Jul 07 17:58:39 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (9de6f4a6-4391-4a63-9a2f-8852558891c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e178a8a4-d22d-4a6f-bab0-9bbb06765570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e178a8a4-d22d-4a6f-bab0-9bbb06765570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-211696870',display_name='tempest-VolumesGetTest-Volume-923612911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027dcbb9-f882-423d-ab55-a5116bc1feef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:40Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cec274-81f6-49e6-afd4-926de9ad5c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cec274-81f6-49e6-afd4-926de9ad5c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d84e0d2-7712-4ecf-8181-01fa86533d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d84e0d2-7712-4ecf-8181-01fa86533d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027dcbb9-f882-423d-ab55-a5116bc1feef', 'volume_name': 'volume-027dcbb9-f882-423d-ab55-a5116bc1feef', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd54545-8194-4760-a946-99e30f5c9662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd54545-8194-4760-a946-99e30f5c9662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f55bab2-fe07-4158-bae1-45cbe37a9225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:39 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Volume 027dcbb9-f882-423d-ab55-a5116bc1feef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027dcbb9-f882-423d-ab55-a5116bc1feef', 'volume_size': 1} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-211696870',display_name='tempest-VolumesGetTest-Volume-923612911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027dcbb9-f882-423d-ab55-a5116bc1feef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:40Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Creating volume 027dcbb9-f882-423d-ab55-a5116bc1feef {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:39 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:39 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef 1073741824 Jul 07 17:58:39 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:40 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD" returned: 0 in 0.796s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:40 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD Jul 07 17:58:40 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:40 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef 1073741824" returned: 0 in 0.963s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:40 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef Jul 07 17:58:40 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Acquiring lock "cinder-8049f151-eaa8-4179-bae1-970f4dd12b8f-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Lock "cinder-8049f151-eaa8-4179-bae1-970f4dd12b8f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Acquiring lock "cinder-quobyte-8049f151-eaa8-4179-bae1-970f4dd12b8f" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Lock "cinder-quobyte-8049f151-eaa8-4179-bae1-970f4dd12b8f" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42f7527-b8f3-4900-acb2-f593a811085a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:41 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f Jul 07 17:58:41 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:41 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD" returned: 1 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:41 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef" returned: 0 in 0.797s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3669da-21e3-4d74-b134-0f798c8f672a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b60cf82b084f97b415f92e4774e10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:37Z,use_quota=True,user_id='e37573d4d34d4ff38d99f6b30eef22d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Creating volume 3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:41 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f55bab2-fe07-4158-bae1-45cbe37a9225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027dcbb9-f882-423d-ab55-a5116bc1feef', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5ffe83-636f-41dc-85e9-ccc0dbb96f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:41 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a 1073741824 Jul 07 17:58:41 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:41 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Volume volume-027dcbb9-f882-423d-ab55-a5116bc1feef (027dcbb9-f882-423d-ab55-a5116bc1feef): created successfully Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5ffe83-636f-41dc-85e9-ccc0dbb96f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (9de6f4a6-4391-4a63-9a2f-8852558891c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2866a8b8-4dfb-4194-ab97-4aeebedf65b1 tempest-VolumesGetTest-1971740301 None] Created volume successfully. Jul 07 17:58:41 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f" returned: 0 in 0.875s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:41 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f Jul 07 17:58:41 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:42 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8049f151-eaa8-4179-bae1-970f4dd12b8f" returned: 0 in 0.740s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Lock "cinder-quobyte-8049f151-eaa8-4179-bae1-970f4dd12b8f" released by "delete_volume" :: held 1.661s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:42 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a 1073741824" returned: 0 in 1.052s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Created reservations ['8722427c-b5ee-4b4c-aab3-5e2ba3f64e16', '392e970a-e58a-4d3f-b67f-15be04807fa3', 'cf2d8405-5e01-4d73-b983-da31663bfc5f', '994af9f9-462d-437d-9954-33ad44eace5b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:42 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a Jul 07 17:58:42 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:42 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:42 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-027dcbb9-f882-423d-ab55-a5116bc1feef-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Lock "cinder-027dcbb9-f882-423d-ab55-a5116bc1feef-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-027dcbb9-f882-423d-ab55-a5116bc1feef" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-027dcbb9-f882-423d-ab55-a5116bc1feef" acquired by "delete_volume" :: waited 0.038s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0174a2ab-2e7b-48ed-a8b7-a9db81557ef4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:43 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef Jul 07 17:58:43 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:43 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a" returned: 0 in 0.993s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Attempting download of 9b8ece32-2bcf-433b-9723-da94d1c7a26f ((None, [{'url': 'file:///opt/stack/data/glance/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'metadata': {}}])) to volume 3d3669da-21e3-4d74-b134-0f798c8f672a. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:58:43 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.980s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Deleted volume successfully. Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-fc2f81ee-83f4-47c6-9933-e4d1c3a325db tempest-VolumesTransfersV357Test-1375828743 None] Lock "cinder-8049f151-eaa8-4179-bae1-970f4dd12b8f-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a5af81-43a4-4db7-b768-95a9b24d10b1]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b8ece32-2bcf-433b-9723-da94d1c7a26f_agn0fljn {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:44 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b8ece32-2bcf-433b-9723-da94d1c7a26f_agn0fljn Jul 07 17:58:44 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:44 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef" returned: 0 in 1.045s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:44 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef Jul 07 17:58:44 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:44 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9b8ece32-2bcf-433b-9723-da94d1c7a26f_agn0fljn" returned: 0 in 0.941s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b8ece32-2bcf-433b-9723-da94d1c7a26f_agn0fljn {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:44 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b8ece32-2bcf-433b-9723-da94d1c7a26f_agn0fljn Jul 07 17:58:44 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:45 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-027dcbb9-f882-423d-ab55-a5116bc1feef" returned: 0 in 0.760s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-027dcbb9-f882-423d-ab55-a5116bc1feef" released by "delete_volume" :: held 1.872s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Created reservations ['85101036-1a2a-47e2-8511-634931166f79', '65bcd778-caec-4d3c-b9db-9a2871f35ce0', '6b8cdabe-162a-460e-9ad3-7e53d04f27ae', '4442bdeb-9242-46d6-bb93-c394499b30d0'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:45 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:45 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-3a60599f-4e74-4dba-a7d6-d7b284ef438e-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Lock "cinder-3a60599f-4e74-4dba-a7d6-d7b284ef438e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:45 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b8ece32-2bcf-433b-9723-da94d1c7a26f_agn0fljn" returned: 1 in 1.023s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9b8ece32-2bcf-433b-9723-da94d1c7a26f_agn0fljn' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aed0e0-7f2e-42ab-aaac-d807cf8d8d62]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-3a60599f-4e74-4dba-a7d6-d7b284ef438e" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-3a60599f-4e74-4dba-a7d6-d7b284ef438e" acquired by "delete_volume" :: waited 0.030s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[260dbaeb-6db8-4cfe-89d6-6fad08c629ec]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:46 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD Jul 07 17:58:46 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:46 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e Jul 07 17:58:46 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:46 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.968s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:46 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:46 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Deleted volume successfully. Jul 07 17:58:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f269c345-b6d2-4175-9b24-27c0ca9e0403 tempest-VolumesGetTest-1971740301 None] Lock "cinder-027dcbb9-f882-423d-ab55-a5116bc1feef-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:46 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD" returned: 0 in 0.997s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:46 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e" returned: 0 in 1.033s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:47 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD Jul 07 17:58:47 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:47 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e Jul 07 17:58:47 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:47 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3a60599f-4e74-4dba-a7d6-d7b284ef438e" returned: 0 in 0.738s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-3a60599f-4e74-4dba-a7d6-d7b284ef438e" released by "delete_volume" :: held 1.846s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:47 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD" returned: 1 in 0.945s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] 9b8ece32-2bcf-433b-9723-da94d1c7a26f was raw, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:47 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a Jul 07 17:58:47 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Created reservations ['f65fef23-e6a6-40da-bbc0-fc9efbfacdf7', '0f5c4bae-4c8a-4759-aa73-93fe4f8bb6c8', '8a26e123-2117-4a34-8e8d-d4f9a2f4b9fc', 'c0b0f5d2-3304-4080-9ae8-2bca49abd1b1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:48 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:48 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-e0cb9164-4820-4171-a8b4-9308492d42fe-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Lock "cinder-e0cb9164-4820-4171-a8b4-9308492d42fe-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-e0cb9164-4820-4171-a8b4-9308492d42fe" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-e0cb9164-4820-4171-a8b4-9308492d42fe" acquired by "delete_volume" :: waited 0.035s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[28efd414-aaad-4d74-9ff4-451d2415cdf9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:48 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe Jul 07 17:58:48 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:48 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a" returned: 0 in 1.147s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9b8ece32-2bcf-433b-9723-da94d1c7a26f_5vh706trdevstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:58:48 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 17:58:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:49 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a 1G Jul 07 17:58:49 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:49 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.166s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Deleted volume successfully. Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d881dedb-0422-4297-8df3-55716ae97fb5 tempest-VolumesGetTest-1971740301 None] Lock "cinder-3a60599f-4e74-4dba-a7d6-d7b284ef438e-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Flow 'volume_create_manager' (6aaa297a-c5e2-4d4d-a841-eacb4e07cf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3d2a7a-798d-4cc2-9d9d-b79c0e151a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3d2a7a-798d-4cc2-9d9d-b79c0e151a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1237029929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ff255c-62e2-4a4e-8f94-13f8ec27821c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708823be1d7044c6b85e8cff7950250b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:50Z,use_quota=True,user_id='3cdbacb64ba64935944ce7e841e324da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc2f7f7-0f88-48c3-8294-4bb502609612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc2f7f7-0f88-48c3-8294-4bb502609612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd00c218-8b19-4d8f-9f46-a731ce59d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd00c218-8b19-4d8f-9f46-a731ce59d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ff255c-62e2-4a4e-8f94-13f8ec27821c', 'volume_name': 'volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da4a7f9-fc19-4219-84a4-62fd5bed062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da4a7f9-fc19-4219-84a4-62fd5bed062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3990b8de-e39d-4d73-989f-fcaebee254bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Volume d1ff255c-62e2-4a4e-8f94-13f8ec27821c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c', 'volume_size': 1} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1237029929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ff255c-62e2-4a4e-8f94-13f8ec27821c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708823be1d7044c6b85e8cff7950250b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:50Z,use_quota=True,user_id='3cdbacb64ba64935944ce7e841e324da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Creating volume d1ff255c-62e2-4a4e-8f94-13f8ec27821c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:49 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:49 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c 1073741824 Jul 07 17:58:49 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:49 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe" returned: 0 in 1.226s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:49 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe Jul 07 17:58:49 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:49 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a 1G" returned: 0 in 1.020s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf877b3-7519-4645-bef7-fa4138a04b77]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:50 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a Jul 07 17:58:50 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:50 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e0cb9164-4820-4171-a8b4-9308492d42fe" returned: 0 in 0.840s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-e0cb9164-4820-4171-a8b4-9308492d42fe" released by "delete_volume" :: held 2.164s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Created reservations ['7973c2d2-1de4-4e0b-8208-d80e1a1bbab9', '6a17ab0f-1022-430f-b13b-9d569efdfeb1', '5f959ded-a8ae-471d-a369-668fdf0bfd80', '23dc1146-2163-49a9-983c-7face9f12b19'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:50 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c 1073741824" returned: 0 in 1.058s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:50 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:50 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:50 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c Jul 07 17:58:50 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:51 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a" returned: 0 in 0.993s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:51 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a Jul 07 17:58:51 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:51 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c" returned: 0 in 0.815s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3990b8de-e39d-4d73-989f-fcaebee254bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:51 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db284b8d-1127-44aa-8989-9cbbaecaf95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.930s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Deleted volume successfully. Jul 07 17:58:51 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Volume volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c (d1ff255c-62e2-4a4e-8f94-13f8ec27821c): created successfully Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db284b8d-1127-44aa-8989-9cbbaecaf95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Flow 'volume_create_manager' (6aaa297a-c5e2-4d4d-a841-eacb4e07cf00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-eb572518-575e-41c1-8611-f0904f7c0078 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Created volume successfully. Jul 07 17:58:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-92b490b3-999a-484f-9060-34b1fe5c3541 tempest-VolumesGetTest-1971740301 None] Lock "cinder-e0cb9164-4820-4171-a8b4-9308492d42fe-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:52 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a" returned: 1 in 1.137s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Downloaded image 9b8ece32-2bcf-433b-9723-da94d1c7a26f ((None, [{'url': 'file:///opt/stack/data/glance/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'metadata': {}}])) to volume 3d3669da-21e3-4d74-b134-0f798c8f672a successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Temporary image 9b8ece32-2bcf-433b-9723-da94d1c7a26f for user e37573d4d34d4ff38d99f6b30eef22d6 is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Marking volume 3d3669da-21e3-4d74-b134-0f798c8f672a as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Copying metadata from image 9b8ece32-2bcf-433b-9723-da94d1c7a26f to 3d3669da-21e3-4d74-b134-0f798c8f672a. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Creating volume glance metadata for volume 3d3669da-21e3-4d74-b134-0f798c8f672a backed by image 9b8ece32-2bcf-433b-9723-da94d1c7a26f with: {'image_id': '9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ebf0cc9aff5a474f7058264ee6cac170', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253d5c5e-e5cf-4dbe-b668-bf77c19c0cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3669da-21e3-4d74-b134-0f798c8f672a', 'volume_size': 1, 'image_id': '9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ebf0cc9aff5a474f7058264ee6cac170', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '23b60cf82b084f97b415f92e4774e10e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f99a6c78607c8b8ea7c2104d7a233dc9b3defee6117b51572da2340195770046bb4a93fb8a40d2c328aeaabf2d2b9021559d4c3ebddf02ebe455fc5c8fd6d001', 'id': '9b8ece32-2bcf-433b-9723-da94d1c7a26f', 'created_at': datetime.datetime(2026, 7, 7, 15, 58, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 58, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9b8ece32-2bcf-433b-9723-da94d1c7a26f/file', 'properties': {}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162bd177-9322-4c33-a799-4652e890b42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:52 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Volume volume-3d3669da-21e3-4d74-b134-0f798c8f672a (3d3669da-21e3-4d74-b134-0f798c8f672a): created successfully Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162bd177-9322-4c33-a799-4652e890b42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Flow 'volume_create_manager' (1173a6a3-ee67-4a42-b056-ca32dd2c6ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:52 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5ba2e6a6-c200-4290-b937-f104ce5a58ae tempest-VolumeImageDependencyTests-348980981 None] Created volume successfully. Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (1f808f16-1a3b-45cd-9083-737b88b59d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5fa183c-ed5f-4d37-8373-8b956fea6fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5fa183c-ed5f-4d37-8373-8b956fea6fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1283465764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b0fba4-6f86-44b9-a883-cdc827d475b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:52Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9807abef-23e6-4a80-bd84-4b7fc541e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9807abef-23e6-4a80-bd84-4b7fc541e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823730e1-1c1c-4372-937d-3230ed810eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Acquiring lock "cinder-3d3669da-21e3-4d74-b134-0f798c8f672a-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Lock "cinder-3d3669da-21e3-4d74-b134-0f798c8f672a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Acquiring lock "cinder-quobyte-3d3669da-21e3-4d74-b134-0f798c8f672a" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Lock "cinder-quobyte-3d3669da-21e3-4d74-b134-0f798c8f672a" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Acquiring lock "cinder-d1ff255c-62e2-4a4e-8f94-13f8ec27821c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4976dda4-4c49-4fee-92e6-fa854b346a84]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "cinder-d1ff255c-62e2-4a4e-8f94-13f8ec27821c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Acquiring lock "cinder-quobyte-d1ff255c-62e2-4a4e-8f94-13f8ec27821c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "cinder-quobyte-d1ff255c-62e2-4a4e-8f94-13f8ec27821c" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:58:53 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a Jul 07 17:58:53 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c186224-94eb-4ba7-a044-5ea23a09518b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823730e1-1c1c-4372-937d-3230ed810eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '95b0fba4-6f86-44b9-a883-cdc827d475b3', 'volume_name': 'volume-95b0fba4-6f86-44b9-a883-cdc827d475b3', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79afcdf4-fc0a-4aa8-b72f-1d636c7bf2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79afcdf4-fc0a-4aa8-b72f-1d636c7bf2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23381f5c-3aea-4744-b7b7-2ee0d94fbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:53 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Volume 95b0fba4-6f86-44b9-a883-cdc827d475b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-95b0fba4-6f86-44b9-a883-cdc827d475b3', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Trying to clone 95b0fba4-6f86-44b9-a883-cdc827d475b3 from image e34b77ca-f38c-49a7-885f-cd463a6fcc7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 17:58:53 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c Jul 07 17:58:53 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 17:58:53 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Image download 20.69 MB at 20.69 MB/s Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d993952c-5f11-4b79-8438-da451a5d025e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:53 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD Jul 07 17:58:53 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:53 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a" returned: 0 in 0.989s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:54 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a Jul 07 17:58:54 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:54 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c" returned: 0 in 1.083s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:54 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c Jul 07 17:58:54 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:54 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD" returned: 0 in 0.934s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Temporary image e34b77ca-f38c-49a7-885f-cd463a6fcc7d is fetched for user 62d6646d3f8f457196107a22370e955a. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4337d1d6-bf95-40bf-a081-f0af3fa50fec]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:54 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD Jul 07 17:58:54 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:54 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a" returned: 1 in 0.952s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:58:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:54 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a Jul 07 17:58:54 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:55 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d1ff255c-62e2-4a4e-8f94-13f8ec27821c" returned: 0 in 0.836s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "cinder-quobyte-d1ff255c-62e2-4a4e-8f94-13f8ec27821c" released by "delete_volume" :: held 2.005s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Created reservations ['905d623f-9ee2-4656-8cc7-fb9d8f02bcef', '0b329fc3-3cad-4ae7-bfad-7476e973d1d1', 'f30cdf5a-cd07-4772-9941-ca61328eb1bc', '3c2e3af4-b339-495c-8b83-36314ff7816f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:55 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:55 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:55 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD" returned: 0 in 1.017s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1283465764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b0fba4-6f86-44b9-a883-cdc827d475b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:52Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Creating volume 95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:55 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:55 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3d3669da-21e3-4d74-b134-0f798c8f672a" returned: 0 in 0.920s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:55 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 1073741824 Jul 07 17:58:55 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Lock "cinder-quobyte-3d3669da-21e3-4d74-b134-0f798c8f672a" released by "delete_volume" :: held 2.975s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Created reservations ['120f5a2e-91f9-4929-ad0d-03a00cfe6b03', '6ca8cf00-0699-4220-aae9-464ad790ddba', 'e0df9238-1812-4ea8-bc75-d4e0f0451fea', 'a136db86-7ce6-4739-a821-53137bfb0aee'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:55 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:58:55 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:56 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.861s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:56 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Deleted volume successfully. Jul 07 17:58:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c45b1660-f1b9-40ee-a6a5-e8aa6783423f tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "cinder-d1ff255c-62e2-4a4e-8f94-13f8ec27821c-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:57 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.300s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:58:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Deleted volume successfully. Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-08fc264c-8578-4ce5-b3d5-347727a0d5fd tempest-VolumeImageDependencyTests-348980981 None] Lock "cinder-3d3669da-21e3-4d74-b134-0f798c8f672a-delete_volume" released by "delete_volume" :: held 4.527s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:58:57 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 1073741824" returned: 0 in 1.525s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:57 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 Jul 07 17:58:57 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Flow 'volume_create_manager' (20904fbf-07d1-4234-8de7-b41140da4128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff9e653-97f4-4209-93b2-a638137e94a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eff9e653-97f4-4209-93b2-a638137e94a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1414308113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4938af92-f02b-49e1-b18c-f3335c8f11d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708823be1d7044c6b85e8cff7950250b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:57Z,use_quota=True,user_id='3cdbacb64ba64935944ce7e841e324da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5f68f8-1453-4ab4-8097-8f0d49703b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f5f68f8-1453-4ab4-8097-8f0d49703b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61b5521-f433-4e91-ad65-5f06dd7df938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c61b5521-f433-4e91-ad65-5f06dd7df938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4938af92-f02b-49e1-b18c-f3335c8f11d4', 'volume_name': 'volume-4938af92-f02b-49e1-b18c-f3335c8f11d4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44029e9c-7b07-4299-954b-023bd7f23c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44029e9c-7b07-4299-954b-023bd7f23c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c32b720-1e80-4294-8d59-179264c58f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:57 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Volume 4938af92-f02b-49e1-b18c-f3335c8f11d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4938af92-f02b-49e1-b18c-f3335c8f11d4', 'volume_size': 1} Jul 07 17:58:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:58 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3" returned: 0 in 0.781s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1414308113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4938af92-f02b-49e1-b18c-f3335c8f11d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708823be1d7044c6b85e8cff7950250b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:57Z,use_quota=True,user_id='3cdbacb64ba64935944ce7e841e324da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Creating volume 4938af92-f02b-49e1-b18c-f3335c8f11d4 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:58 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:58 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 1073741824 Jul 07 17:58:58 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Attempting download of e34b77ca-f38c-49a7-885f-cd463a6fcc7d ((None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}])) to volume 95b0fba4-6f86-44b9-a883-cdc827d475b3. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[053db3a1-9f46-462e-b58e-1ab91fa6e663]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:58:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ji54h3c0 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:58 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ji54h3c0 Jul 07 17:58:58 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:59 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 1073741824" returned: 0 in 1.101s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:59 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ji54h3c0" returned: 0 in 0.993s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:59 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 Jul 07 17:58:59 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ji54h3c0 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:59 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ji54h3c0 Jul 07 17:58:59 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:00 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4" returned: 0 in 0.949s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c32b720-1e80-4294-8d59-179264c58f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4938af92-f02b-49e1-b18c-f3335c8f11d4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5a8623-c7fc-4c47-b4e7-c6bf7adf15bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:00 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ji54h3c0" returned: 1 in 0.969s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ji54h3c0' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e441b68f-616e-47c7-b3e6-eca3e1e5f653]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:00 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Volume volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 (4938af92-f02b-49e1-b18c-f3335c8f11d4): created successfully Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5a8623-c7fc-4c47-b4e7-c6bf7adf15bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Flow 'volume_create_manager' (20904fbf-07d1-4234-8de7-b41140da4128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-db2db0e3-38ac-487f-8aa2-76ef3de6ab18 tempest-VolumeQuotasAdminTestJSON-1823781785 None] Created volume successfully. Jul 07 17:59:00 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD Jul 07 17:59:00 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:01 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD" returned: 0 in 0.995s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] e34b77ca-f38c-49a7-885f-cd463a6fcc7d was qcow2, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:01 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 Jul 07 17:59:01 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:01 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3f4230de-f9fd-4a80-be3f-90b6adc14d89 tempest-VolumeQuotasAdminTestJSON-1810972746 None] Transfer volume completed successfully. Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Flow 'volume_create_manager' (6e4b65c4-3585-42df-86ff-2775fc76edba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942f39bd-a928-4574-9d5b-deae1d764de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942f39bd-a928-4574-9d5b-deae1d764de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951639192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42b6874-9e26-4fa9-8345-ddbc8f300284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02792dd6e80412998b24558a9400906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:02Z,use_quota=True,user_id='d4e15543520148fa90091e83a0eb66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad7c2bf-8e90-4729-ae11-60afe8d5467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad7c2bf-8e90-4729-ae11-60afe8d5467d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34ea26a-b361-4bd0-b5e3-785c27e36613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34ea26a-b361-4bd0-b5e3-785c27e36613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42b6874-9e26-4fa9-8345-ddbc8f300284', 'volume_name': 'volume-f42b6874-9e26-4fa9-8345-ddbc8f300284', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3701bfb5-649a-40d2-8148-088d95f60948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3701bfb5-649a-40d2-8148-088d95f60948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f910bcb-13e7-44b2-ad8a-d6a54d358cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Volume f42b6874-9e26-4fa9-8345-ddbc8f300284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42b6874-9e26-4fa9-8345-ddbc8f300284', 'volume_size': 1} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951639192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42b6874-9e26-4fa9-8345-ddbc8f300284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02792dd6e80412998b24558a9400906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:02Z,use_quota=True,user_id='d4e15543520148fa90091e83a0eb66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Creating volume f42b6874-9e26-4fa9-8345-ddbc8f300284 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:02 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:02 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 1073741824 Jul 07 17:59:02 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Acquiring lock "cinder-4938af92-f02b-49e1-b18c-f3335c8f11d4-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Lock "cinder-4938af92-f02b-49e1-b18c-f3335c8f11d4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Acquiring lock "cinder-quobyte-4938af92-f02b-49e1-b18c-f3335c8f11d4" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Lock "cinder-quobyte-4938af92-f02b-49e1-b18c-f3335c8f11d4" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b02450-6765-4461-bc2a-c3afdf14345e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:03 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 Jul 07 17:59:03 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:03 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 1073741824" returned: 0 in 1.215s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:03 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 Jul 07 17:59:03 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:03 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3" returned: 0 in 2.574s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_sk0ak1frdevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 17:59:03 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Converted 112.00 MB image at 43.43 MB/s Jul 07 17:59:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:03 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 1G Jul 07 17:59:03 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:04 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284" returned: 0 in 0.890s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:04 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4" returned: 0 in 1.177s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f910bcb-13e7-44b2-ad8a-d6a54d358cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42b6874-9e26-4fa9-8345-ddbc8f300284', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:04 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4 Jul 07 17:59:04 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fed09b-b06e-4a1f-bab1-2c6c83c065fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:04 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Volume volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 (f42b6874-9e26-4fa9-8345-ddbc8f300284): created successfully Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fed09b-b06e-4a1f-bab1-2c6c83c065fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Flow 'volume_create_manager' (6e4b65c4-3585-42df-86ff-2775fc76edba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-63e7d926-1e10-4d5f-93fe-ca3d08b561ee tempest-ProjectReaderTests-42947708 None] Created volume successfully. Jul 07 17:59:04 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 1G" returned: 0 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[492a140c-cc37-4227-9a23-b6ea132dd6f4]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:04 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 Jul 07 17:59:04 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:05 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4938af92-f02b-49e1-b18c-f3335c8f11d4" returned: 0 in 0.948s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Lock "cinder-quobyte-4938af92-f02b-49e1-b18c-f3335c8f11d4" released by "delete_volume" :: held 2.194s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Created reservations ['96dd7ed7-9f74-4caa-86cd-7a4960f4fbf1', 'c8aa2924-a32b-4391-b863-c35d44333dc4', '91aad756-451a-4e90-b894-9b520cd31fab', 'b72dfb91-f0ba-43a3-808a-8cde3be368a7'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Acquiring lock "cinder-f42b6874-9e26-4fa9-8345-ddbc8f300284-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Lock "cinder-f42b6874-9e26-4fa9-8345-ddbc8f300284-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:05 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:05 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Acquiring lock "cinder-quobyte-f42b6874-9e26-4fa9-8345-ddbc8f300284" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Lock "cinder-quobyte-f42b6874-9e26-4fa9-8345-ddbc8f300284" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c237827f-5ba6-4345-8019-227e9ace110a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:05 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 Jul 07 17:59:05 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:05 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3" returned: 0 in 1.162s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:06 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 Jul 07 17:59:06 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:06 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.923s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:06 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Deleted volume successfully. Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c02a92d0-3087-4725-941a-7d8c7873bfd2 tempest-VolumeQuotasAdminTestJSON-1000351914 None] Lock "cinder-4938af92-f02b-49e1-b18c-f3335c8f11d4-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:06 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284" returned: 0 in 1.063s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:06 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284 Jul 07 17:59:06 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Flow 'volume_create_manager' (74044b59-3638-4f1a-874d-ac5ab3cd8a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a891a06-2346-4abd-96ad-9f19de4b9e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a891a06-2346-4abd-96ad-9f19de4b9e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815112889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40409b5b22594611b8ccccdf1533a7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:07Z,use_quota=True,user_id='728b06eb1168475aa9141b0cf7281c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7247b9-0b9c-4926-a30a-1a4e2d8b710c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df7247b9-0b9c-4926-a30a-1a4e2d8b710c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1993af-4894-4d66-b05d-97d11db267f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1993af-4894-4d66-b05d-97d11db267f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4', 'volume_name': 'volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fbe190-60aa-407c-b630-c738f4f80758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fbe190-60aa-407c-b630-c738f4f80758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae25edb6-cf61-450c-9454-3d649cc166ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:06 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Volume 28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4', 'volume_size': 1} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815112889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40409b5b22594611b8ccccdf1533a7ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:07Z,use_quota=True,user_id='728b06eb1168475aa9141b0cf7281c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Creating volume 28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:06 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:06 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 1073741824 Jul 07 17:59:06 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:07 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3" returned: 1 in 1.111s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Downloaded image e34b77ca-f38c-49a7-885f-cd463a6fcc7d ((None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}])) to volume 95b0fba4-6f86-44b9-a883-cdc827d475b3 successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Temporary image e34b77ca-f38c-49a7-885f-cd463a6fcc7d for user 62d6646d3f8f457196107a22370e955a is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Marking volume 95b0fba4-6f86-44b9-a883-cdc827d475b3 as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Copying metadata from image e34b77ca-f38c-49a7-885f-cd463a6fcc7d to 95b0fba4-6f86-44b9-a883-cdc827d475b3. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Creating volume glance metadata for volume 95b0fba4-6f86-44b9-a883-cdc827d475b3 backed by image e34b77ca-f38c-49a7-885f-cd463a6fcc7d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23381f5c-3aea-4744-b7b7-2ee0d94fbf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b0fba4-6f86-44b9-a883-cdc827d475b3', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606d1911-4466-47be-8096-f4cea1f8a0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:07 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Volume volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 (95b0fba4-6f86-44b9-a883-cdc827d475b3): created successfully Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606d1911-4466-47be-8096-f4cea1f8a0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (1f808f16-1a3b-45cd-9083-737b88b59d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-00efeac0-3eaa-431d-a279-f9bab8622048 tempest-VolumesGetTest-1971740301 None] Created volume successfully. Jul 07 17:59:07 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f42b6874-9e26-4fa9-8345-ddbc8f300284" returned: 0 in 0.775s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Lock "cinder-quobyte-f42b6874-9e26-4fa9-8345-ddbc8f300284" released by "delete_volume" :: held 1.889s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Created reservations ['182f71d8-d64e-4f6e-b411-655588bdb5b9', 'fc45336a-c18f-4e2f-ac76-b8ad81ee5934', '200b59e8-c466-47b8-b124-0f8fdfe6be46', '3b9184bb-4c12-48e8-aeb1-b6f7ace71730'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:07 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:07 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:08 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 1073741824" returned: 0 in 1.130s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=139,cinder:INSERT=57,cinder:UPDATE=177,cinder:DELETE=16 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:08 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 17:59:08 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:08 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.934s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Deleted volume successfully. Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=201,cinder:SELECT=122,cinder:DELETE=15,cinder:INSERT=53 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-884d3c11-adb5-4c8f-a2d9-b3679fd3c4b5 tempest-ProjectReaderTests-42947708 None] Lock "cinder-f42b6874-9e26-4fa9-8345-ddbc8f300284-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Flow 'volume_create_manager' (ddf8b69e-0671-447c-bb5c-2e01ac68536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cca5abb-1ab5-414a-8bba-2025125bc2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cca5abb-1ab5-414a-8bba-2025125bc2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331128210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eefe016-a6c7-4c37-b73b-c989d9a9c82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02792dd6e80412998b24558a9400906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:08Z,use_quota=True,user_id='d4e15543520148fa90091e83a0eb66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba64bc2-5df5-4e6d-a424-cec363748772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba64bc2-5df5-4e6d-a424-cec363748772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806e72c2-e767-4ad6-8472-40c231b2d222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806e72c2-e767-4ad6-8472-40c231b2d222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eefe016-a6c7-4c37-b73b-c989d9a9c82a', 'volume_name': 'volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b99d10-cebb-4510-a081-63164bde2e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9b99d10-cebb-4510-a081-63164bde2e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280e43c5-3789-4d51-ae66-846dcb7aeb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:08 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Volume 0eefe016-a6c7-4c37-b73b-c989d9a9c82a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a', 'volume_size': 1} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:08 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.898s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.237s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331128210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eefe016-a6c7-4c37-b73b-c989d9a9c82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02792dd6e80412998b24558a9400906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:08Z,use_quota=True,user_id='d4e15543520148fa90091e83a0eb66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Creating volume 0eefe016-a6c7-4c37-b73b-c989d9a9c82a {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:08 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:09 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a 1073741824 Jul 07 17:59:09 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae25edb6-cf61-450c-9454-3d649cc166ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c87854d-0d9c-401b-9c25-64c7a60b556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:09 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Volume volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 (28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4): created successfully Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c87854d-0d9c-401b-9c25-64c7a60b556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Flow 'volume_create_manager' (74044b59-3638-4f1a-874d-ac5ab3cd8a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:09 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bd7229ce-2e09-48f3-ad3a-bbef73e038f1 tempest-VolumesActionsTest-760088134 None] Created volume successfully. Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (591829dc-2bb9-4096-901f-fc9544c40088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df016c65-1d0f-414d-b14f-4a1619b62bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df016c65-1d0f-414d-b14f-4a1619b62bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-922348240',display_name='tempest-VolumesGetTest-Volume-264998472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e1e013-9628-4eae-9ea3-bd25858b1e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:09Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b7f1ae-7f5b-409f-ae78-d04774b37d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b7f1ae-7f5b-409f-ae78-d04774b37d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634b76c1-4136-4fe2-a868-948ef82e352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634b76c1-4136-4fe2-a868-948ef82e352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e1e013-9628-4eae-9ea3-bd25858b1e87', 'volume_name': 'volume-99e1e013-9628-4eae-9ea3-bd25858b1e87', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42ea68c-3ddf-4db1-a1ce-4eae2bba37b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42ea68c-3ddf-4db1-a1ce-4eae2bba37b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aa164e-c40f-44e1-ba86-354efe56847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:09 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Volume 99e1e013-9628-4eae-9ea3-bd25858b1e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e1e013-9628-4eae-9ea3-bd25858b1e87', 'volume_size': 1} Jul 07 17:59:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:10 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a 1073741824" returned: 0 in 1.081s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:10 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a Jul 07 17:59:10 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:10 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a" returned: 0 in 0.745s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.411s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-922348240',display_name='tempest-VolumesGetTest-Volume-264998472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e1e013-9628-4eae-9ea3-bd25858b1e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076229d6cda64ef8adf8aa600b3a530f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:09Z,use_quota=True,user_id='62d6646d3f8f457196107a22370e955a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Creating volume 99e1e013-9628-4eae-9ea3-bd25858b1e87 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:10 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280e43c5-3789-4d51-ae66-846dcb7aeb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:10 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 1073741824 Jul 07 17:59:10 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04adc5f7-63a4-42ec-8ef1-5d49596561c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:10 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Volume volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a (0eefe016-a6c7-4c37-b73b-c989d9a9c82a): created successfully Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04adc5f7-63a4-42ec-8ef1-5d49596561c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Flow 'volume_create_manager' (ddf8b69e-0671-447c-bb5c-2e01ac68536d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-31b2e260-da0d-4896-b55a-9bf967b0874b tempest-ProjectReaderTests-42947708 None] Created volume successfully. Jul 07 17:59:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Acquiring lock "cinder-0eefe016-a6c7-4c37-b73b-c989d9a9c82a-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Lock "cinder-0eefe016-a6c7-4c37-b73b-c989d9a9c82a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Acquiring lock "cinder-quobyte-0eefe016-a6c7-4c37-b73b-c989d9a9c82a" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Lock "cinder-quobyte-0eefe016-a6c7-4c37-b73b-c989d9a9c82a" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:11 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d085a18-dc0a-471f-ba43-0893c194d235]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:11 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a Jul 07 17:59:11 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:12 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 1073741824" returned: 0 in 1.343s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:12 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 Jul 07 17:59:12 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:12 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a" returned: 0 in 0.990s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:12 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a Jul 07 17:59:12 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:13 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87" returned: 0 in 0.821s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40aa164e-c40f-44e1-ba86-354efe56847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e1e013-9628-4eae-9ea3-bd25858b1e87', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f45272-1386-4c2e-9ef0-854c5548bb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:13 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Volume volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 (99e1e013-9628-4eae-9ea3-bd25858b1e87): created successfully Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f45272-1386-4c2e-9ef0-854c5548bb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Flow 'volume_create_manager' (591829dc-2bb9-4096-901f-fc9544c40088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:13 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1f55debd-964f-499a-8866-25d601b57c8d tempest-VolumesGetTest-1971740301 None] Created volume successfully. Jul 07 17:59:13 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0eefe016-a6c7-4c37-b73b-c989d9a9c82a" returned: 0 in 0.691s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Lock "cinder-quobyte-0eefe016-a6c7-4c37-b73b-c989d9a9c82a" released by "delete_volume" :: held 1.731s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Created reservations ['e859c03f-c529-4e19-83cd-5eaa23ed6a3d', '0a21a008-b8fa-4421-a305-e7adfe1ea665', 'cc094b9f-af41-45fc-85b5-8a6e04da174b', 'd90c5dad-a26b-474b-860f-b1cf8e32d8d3'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:13 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:13 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-99e1e013-9628-4eae-9ea3-bd25858b1e87-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Lock "cinder-99e1e013-9628-4eae-9ea3-bd25858b1e87-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-99e1e013-9628-4eae-9ea3-bd25858b1e87" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-99e1e013-9628-4eae-9ea3-bd25858b1e87" acquired by "delete_volume" :: waited 0.035s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6377a2f6-3ba7-42b5-b370-b53b48210cb5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:14 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 Jul 07 17:59:14 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:14 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Flow 'volume_create_manager' (9bcd7c10-a9a4-4f97-b532-b378b6a0b872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf36a24d-daea-4e7d-a6fe-a35ca883d14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.052s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Deleted volume successfully. Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf36a24d-daea-4e7d-a6fe-a35ca883d14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1702611925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fb87c0-4036-4706-8dfc-9d55885647fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02792dd6e80412998b24558a9400906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:15Z,use_quota=True,user_id='d4e15543520148fa90091e83a0eb66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b038af2-df8b-4890-8c37-0ac0487048f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b038af2-df8b-4890-8c37-0ac0487048f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a66dfc9-811e-4af3-8301-d3062c0e5886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a66dfc9-811e-4af3-8301-d3062c0e5886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63fb87c0-4036-4706-8dfc-9d55885647fc', 'volume_name': 'volume-63fb87c0-4036-4706-8dfc-9d55885647fc', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bccb5f-3170-4cd3-9dcf-8f94adaf9509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3bccb5f-3170-4cd3-9dcf-8f94adaf9509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f136156d-db10-4b9c-8695-8ae6d119a08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:14 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Volume 63fb87c0-4036-4706-8dfc-9d55885647fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63fb87c0-4036-4706-8dfc-9d55885647fc', 'volume_size': 1} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1702611925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63fb87c0-4036-4706-8dfc-9d55885647fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02792dd6e80412998b24558a9400906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:15Z,use_quota=True,user_id='d4e15543520148fa90091e83a0eb66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Creating volume 63fb87c0-4036-4706-8dfc-9d55885647fc {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:14 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff553a07-97f7-4348-8308-798d83c1d0d8 tempest-ProjectReaderTests-42947708 None] Lock "cinder-0eefe016-a6c7-4c37-b73b-c989d9a9c82a-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:14 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc 1073741824 Jul 07 17:59:14 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:15 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87" returned: 0 in 1.111s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:15 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87 Jul 07 17:59:15 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Flow 'volume_create_manager' (117cea70-5027-413c-9b70-237a23468541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2979dbbe-b753-49ee-ad5f-bd62805d8854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2979dbbe-b753-49ee-ad5f-bd62805d8854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1772537630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6872a6bb-8a7b-477c-9c6f-f44d635cdb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d010873031a40db9240c8869b6d4122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:16Z,use_quota=True,user_id='6bf4ddd19f8f46e9831800e09985ce39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6372ad7-7b5c-4b42-879f-e4777aa3bfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:15 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6372ad7-7b5c-4b42-879f-e4777aa3bfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9032b606-897c-4fee-950d-6f544782517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9032b606-897c-4fee-950d-6f544782517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6872a6bb-8a7b-477c-9c6f-f44d635cdb8c', 'volume_name': 'volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d752ce8-dbf1-42bb-a767-cbee14ddc17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d752ce8-dbf1-42bb-a767-cbee14ddc17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6182f3-be10-4080-9279-2c997d9d9040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Volume 6872a6bb-8a7b-477c-9c6f-f44d635cdb8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c', 'volume_size': 1} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc 1073741824" returned: 0 in 1.104s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:15 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99e1e013-9628-4eae-9ea3-bd25858b1e87" returned: 0 in 0.754s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:15 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc Jul 07 17:59:15 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-99e1e013-9628-4eae-9ea3-bd25858b1e87" released by "delete_volume" :: held 1.942s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Created reservations ['3d0a5a55-d168-4a4a-b8ac-35d26e87cfc3', 'd9c45a4e-6645-4f2b-9327-6c7dd806c3a8', '3b95270b-3605-4f0f-8fad-54f4c200b939', 'bc41ffae-4069-48fd-bac7-ff9d563cc71c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:16 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:16 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-95b0fba4-6f86-44b9-a883-cdc827d475b3-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Lock "cinder-95b0fba4-6f86-44b9-a883-cdc827d475b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Acquiring lock "cinder-quobyte-95b0fba4-6f86-44b9-a883-cdc827d475b3" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-95b0fba4-6f86-44b9-a883-cdc827d475b3" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d259e9-4c61-4feb-8866-6765481546b9]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:16 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 Jul 07 17:59:16 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:16 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc" returned: 0 in 0.722s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1772537630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6872a6bb-8a7b-477c-9c6f-f44d635cdb8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d010873031a40db9240c8869b6d4122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:16Z,use_quota=True,user_id='6bf4ddd19f8f46e9831800e09985ce39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Creating volume 6872a6bb-8a7b-477c-9c6f-f44d635cdb8c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:16 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f136156d-db10-4b9c-8695-8ae6d119a08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63fb87c0-4036-4706-8dfc-9d55885647fc', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:16 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c 1073741824 Jul 07 17:59:16 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b286da96-ba73-4b31-a6a2-dbe6eded8b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:16 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Volume volume-63fb87c0-4036-4706-8dfc-9d55885647fc (63fb87c0-4036-4706-8dfc-9d55885647fc): created successfully Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b286da96-ba73-4b31-a6a2-dbe6eded8b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Flow 'volume_create_manager' (9bcd7c10-a9a4-4f97-b532-b378b6a0b872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8645df8e-a282-4ef0-8093-1ac1f0647bb9 tempest-ProjectReaderTests-42947708 None] Created volume successfully. Jul 07 17:59:16 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.806s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:16 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Deleted volume successfully. Jul 07 17:59:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9be01dbe-f5aa-4b29-bc27-c197cb75effa tempest-VolumesGetTest-1971740301 None] Lock "cinder-99e1e013-9628-4eae-9ea3-bd25858b1e87-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:17 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3" returned: 0 in 0.966s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:17 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 Jul 07 17:59:17 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:17 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c 1073741824" returned: 0 in 1.178s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:17 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c Jul 07 17:59:17 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Acquiring lock "cinder-63fb87c0-4036-4706-8dfc-9d55885647fc-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Lock "cinder-63fb87c0-4036-4706-8dfc-9d55885647fc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Acquiring lock "cinder-quobyte-63fb87c0-4036-4706-8dfc-9d55885647fc" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Lock "cinder-quobyte-63fb87c0-4036-4706-8dfc-9d55885647fc" acquired by "delete_volume" :: waited 0.042s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff86c9a3-5cba-408f-ba07-84cb6a98a547]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:18 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc Jul 07 17:59:18 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:18 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3" returned: 1 in 1.117s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:18 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3 Jul 07 17:59:18 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:18 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c" returned: 0 in 0.948s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.198s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6182f3-be10-4080-9279-2c997d9d9040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed22d10-848a-4311-a2a4-380e454a144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Volume volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c (6872a6bb-8a7b-477c-9c6f-f44d635cdb8c): created successfully Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed22d10-848a-4311-a2a4-380e454a144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Flow 'volume_create_manager' (117cea70-5027-413c-9b70-237a23468541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d980aa45-902c-48af-8ed4-9d575a9912cf tempest-VolumesServicesTestJSON-1818137247 None] Created volume successfully. Jul 07 17:59:19 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc" returned: 0 in 1.181s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:19 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc Jul 07 17:59:19 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:19 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-95b0fba4-6f86-44b9-a883-cdc827d475b3" returned: 0 in 1.060s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Lock "cinder-quobyte-95b0fba4-6f86-44b9-a883-cdc827d475b3" released by "delete_volume" :: held 3.234s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Created reservations ['ac490314-495b-4184-b93f-bbcb844dd4c5', 'c0a54cd5-96bb-45b0-9a78-545807065b7e', '754f3fda-cd80-4519-9900-d2f6ea5f5d2c', 'e0dc0666-ca67-4015-a489-906fe0c54c1e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:19 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:19 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:20 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-63fb87c0-4036-4706-8dfc-9d55885647fc" returned: 0 in 0.717s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Lock "cinder-quobyte-63fb87c0-4036-4706-8dfc-9d55885647fc" released by "delete_volume" :: held 1.969s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Created reservations ['0a97d4a4-9057-4b7f-ab7f-b88bfae4e20d', '67240258-1918-4a0d-9804-a84c409f3623', '625aac33-18fc-44bd-973e-a82d0f7b635a', '816d635a-354c-4dfe-b8b7-ea36f976e90b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:20 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:20 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Acquiring lock "cinder-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Lock "cinder-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Acquiring lock "cinder-quobyte-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Lock "cinder-quobyte-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:20 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.836s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Deleted volume successfully. Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[42512f2b-cd09-4c91-98af-be9c1d1f9e21]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-568bd016-ded6-4ffa-818f-f01aaae2a512 tempest-VolumesGetTest-1971740301 None] Lock "cinder-95b0fba4-6f86-44b9-a883-cdc827d475b3-delete_volume" released by "delete_volume" :: held 4.342s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:20 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c Jul 07 17:59:20 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Flow 'volume_create_manager' (aad80acb-3af0-4d54-8c51-0267ee4c0421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c4c053-237d-4c0f-9489-f880f86fc190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c4c053-237d-4c0f-9489-f880f86fc190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801402129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db38b96c-83f6-4a2b-a916-937dd09989de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02792dd6e80412998b24558a9400906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:21Z,use_quota=True,user_id='d4e15543520148fa90091e83a0eb66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5563bc5f-c91b-46d6-aa7f-3b7e80967678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5563bc5f-c91b-46d6-aa7f-3b7e80967678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01d1ff1-a782-4771-bcac-18827f5f91c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d01d1ff1-a782-4771-bcac-18827f5f91c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db38b96c-83f6-4a2b-a916-937dd09989de', 'volume_name': 'volume-db38b96c-83f6-4a2b-a916-937dd09989de', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e7cd24-3872-4baf-b62c-32541b26fd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e7cd24-3872-4baf-b62c-32541b26fd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590f1ffa-0f12-4b4b-b752-3d511ba38837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:21 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Volume db38b96c-83f6-4a2b-a916-937dd09989de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db38b96c-83f6-4a2b-a916-937dd09989de', 'volume_size': 1} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-801402129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db38b96c-83f6-4a2b-a916-937dd09989de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02792dd6e80412998b24558a9400906',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:21Z,use_quota=True,user_id='d4e15543520148fa90091e83a0eb66b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Creating volume db38b96c-83f6-4a2b-a916-937dd09989de {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:21 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:21 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de 1073741824 Jul 07 17:59:21 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:21 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.025s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Deleted volume successfully. Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0b34406-b579-4336-8ff9-6e4f6e149816 tempest-ProjectReaderTests-42947708 None] Lock "cinder-63fb87c0-4036-4706-8dfc-9d55885647fc-delete_volume" released by "delete_volume" :: held 3.308s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:21 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c" returned: 0 in 0.901s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:21 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c Jul 07 17:59:21 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:22 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de 1073741824" returned: 0 in 1.073s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:22 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de Jul 07 17:59:22 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:22 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c" returned: 0 in 0.801s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Lock "cinder-quobyte-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c" released by "delete_volume" :: held 1.764s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Created reservations ['944fe355-66fe-4c3f-89b3-8a480b3d0df6', 'bd285541-ca2b-4912-afbc-dfb3cc5c8253', 'cb41580e-b03d-4989-ba47-781c01e5fc9b', 'f2ecd99c-ca3e-45ce-b2b5-b004d8736c6e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:22 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:22 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:23 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de" returned: 0 in 0.802s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590f1ffa-0f12-4b4b-b752-3d511ba38837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db38b96c-83f6-4a2b-a916-937dd09989de', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32655536-0ea6-4422-aa91-cae668d92a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:23 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Volume volume-db38b96c-83f6-4a2b-a916-937dd09989de (db38b96c-83f6-4a2b-a916-937dd09989de): created successfully Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32655536-0ea6-4422-aa91-cae668d92a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Flow 'volume_create_manager' (aad80acb-3af0-4d54-8c51-0267ee4c0421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cb60f702-4fb0-4413-b46a-2ee8b6cb86bb tempest-ProjectReaderTests-42947708 None] Created volume successfully. Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.794s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:23 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Deleted volume successfully. Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a5b5646a-95fe-4ba8-beea-87f62287fdb4 tempest-VolumesServicesTestJSON-1818137247 None] Lock "cinder-6872a6bb-8a7b-477c-9c6f-f44d635cdb8c-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:23 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:23 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Acquiring lock "cinder-db38b96c-83f6-4a2b-a916-937dd09989de-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Lock "cinder-db38b96c-83f6-4a2b-a916-937dd09989de-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Acquiring lock "cinder-quobyte-db38b96c-83f6-4a2b-a916-937dd09989de" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Lock "cinder-quobyte-db38b96c-83f6-4a2b-a916-937dd09989de" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9161e0a-edb4-4614-af1e-f79f43933eb3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:24 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de Jul 07 17:59:24 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:25 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.256s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Flow 'volume_create_manager' (fda5d6bd-6351-48ff-90f7-3572b6e234be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b837113f-06e2-4505-9731-a7142b6d8614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b837113f-06e2-4505-9731-a7142b6d8614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1640767615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcada84-d23f-4c0b-828b-9a89e976f1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf7895a9c7f4e3da6890a69a74e8daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:25Z,use_quota=True,user_id='75f9723b3a5a416d9ba62406dc972914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1766887a-bc2d-492d-9ab2-25a7f461b903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1766887a-bc2d-492d-9ab2-25a7f461b903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b446cf-ba86-4dab-822e-c20384aafe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b446cf-ba86-4dab-822e-c20384aafe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fcada84-d23f-4c0b-828b-9a89e976f1f6', 'volume_name': 'volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b5768-6132-4c35-bcaa-8c57d9620ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b5768-6132-4c35-bcaa-8c57d9620ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c634c3d0-6d9a-4871-a62f-457ab4b47530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:25 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Volume 9fcada84-d23f-4c0b-828b-9a89e976f1f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6', 'volume_size': 1} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1640767615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcada84-d23f-4c0b-828b-9a89e976f1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abf7895a9c7f4e3da6890a69a74e8daa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:25Z,use_quota=True,user_id='75f9723b3a5a416d9ba62406dc972914',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Creating volume 9fcada84-d23f-4c0b-828b-9a89e976f1f6 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:25 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:25 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de" returned: 0 in 1.124s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:25 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 1073741824 Jul 07 17:59:25 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:25 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de Jul 07 17:59:25 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:26 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-db38b96c-83f6-4a2b-a916-937dd09989de" returned: 0 in 1.030s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Lock "cinder-quobyte-db38b96c-83f6-4a2b-a916-937dd09989de" released by "delete_volume" :: held 2.208s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:26 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Created reservations ['6ef08667-6798-48bf-807c-573d486cc1df', '7728e782-fefd-44a8-895e-4316712b809b', 'e57b8bff-bf55-402a-a400-6a9263831f5b', '69429e35-9253-43b2-83d1-99e3f91a5125'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:26 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 1073741824" returned: 0 in 1.244s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:27 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 Jul 07 17:59:27 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:27 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:27 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:28 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6" returned: 0 in 1.099s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] <== create_volume: return (2429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c634c3d0-6d9a-4871-a62f-457ab4b47530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:28 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07652fd1-8d22-4c36-ad77-d716de7380bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.117s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Deleted volume successfully. Jul 07 17:59:28 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Volume volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 (9fcada84-d23f-4c0b-828b-9a89e976f1f6): created successfully Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07652fd1-8d22-4c36-ad77-d716de7380bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Flow 'volume_create_manager' (fda5d6bd-6351-48ff-90f7-3572b6e234be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c29f9eb3-6516-4bb4-bf61-1fb4d6aec3b5 tempest-VolumesNegativeTest-160881662 None] Created volume successfully. Jul 07 17:59:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76199f07-6155-46d1-af9a-76e4a9565d9a tempest-ProjectReaderTests-42947708 None] Lock "cinder-db38b96c-83f6-4a2b-a916-937dd09989de-delete_volume" released by "delete_volume" :: held 3.785s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b0c03cfb-1370-477d-a6be-07a87f2a10bb tempest-VolumesActionsTest-760088134 None] Acquiring lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" by "attach_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b0c03cfb-1370-477d-a6be-07a87f2a10bb tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" acquired by "attach_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b0c03cfb-1370-477d-a6be-07a87f2a10bb tempest-VolumesActionsTest-760088134 None] Attaching volume 28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 to instance 284ecc8f-c792-4f47-afe0-2ef2623a34e6 at mountpoint /dev/vdb on host None. Jul 07 17:59:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b0c03cfb-1370-477d-a6be-07a87f2a10bb tempest-VolumesActionsTest-760088134 None] Attach volume completed successfully. Jul 07 17:59:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b0c03cfb-1370-477d-a6be-07a87f2a10bb tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" released by "attach_volume" :: held 0.116s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-37f26254-0319-43c2-b93c-d3c9b9ca6b63 tempest-VolumesActionsTest-760088134 None] Acquiring lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-detach_volume" by "detach_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-37f26254-0319-43c2-b93c-d3c9b9ca6b63 tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-37f26254-0319-43c2-b93c-d3c9b9ca6b63 tempest-VolumesActionsTest-760088134 None] Detaching volume 28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 from instance 284ecc8f-c792-4f47-afe0-2ef2623a34e6. Jul 07 17:59:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-37f26254-0319-43c2-b93c-d3c9b9ca6b63 tempest-VolumesActionsTest-760088134 None] Detach volume completed successfully. Jul 07 17:59:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-37f26254-0319-43c2-b93c-d3c9b9ca6b63 tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:31 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 17:59:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Flow 'volume_create_manager' (c8ac68f0-0895-4a10-8ac5-cb8a06f7b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea8f867-7992-475f-82a4-7208238a2213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea8f867-7992-475f-82a4-7208238a2213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1663515601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa68f58c-d99c-4779-ac3f-119abac354de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ec50322d074a5593a55b2164acb8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:32Z,use_quota=True,user_id='575175943106439ebf5c9f3ab4522f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df925d23-e688-4802-ab7c-dd1895a543bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df925d23-e688-4802-ab7c-dd1895a543bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b6648f-79e0-43f7-a1d0-9a2e5fc0a043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b6648f-79e0-43f7-a1d0-9a2e5fc0a043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa68f58c-d99c-4779-ac3f-119abac354de', 'volume_name': 'volume-aa68f58c-d99c-4779-ac3f-119abac354de', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf569052-9200-4a93-b48e-27f293900743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf569052-9200-4a93-b48e-27f293900743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05efe9a3-65b1-458f-9009-996533ed418f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:32 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Volume aa68f58c-d99c-4779-ac3f-119abac354de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa68f58c-d99c-4779-ac3f-119abac354de', 'volume_size': 1} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1663515601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa68f58c-d99c-4779-ac3f-119abac354de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ec50322d074a5593a55b2164acb8e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:32Z,use_quota=True,user_id='575175943106439ebf5c9f3ab4522f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Creating volume aa68f58c-d99c-4779-ac3f-119abac354de {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:32 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 17:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:32 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de 1073741824 Jul 07 17:59:32 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:33 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de 1073741824" returned: 0 in 1.167s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:33 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de Jul 07 17:59:33 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:34 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de" returned: 0 in 0.726s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05efe9a3-65b1-458f-9009-996533ed418f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa68f58c-d99c-4779-ac3f-119abac354de', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83638e3-96fc-466b-83e5-0bf69b02d5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:34 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Volume volume-aa68f58c-d99c-4779-ac3f-119abac354de (aa68f58c-d99c-4779-ac3f-119abac354de): created successfully Jul 07 17:59:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83638e3-96fc-466b-83e5-0bf69b02d5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Flow 'volume_create_manager' (c8ac68f0-0895-4a10-8ac5-cb8a06f7b51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:34 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-49ba220c-00d6-4282-917b-bb15a691b016 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Created volume successfully. Jul 07 17:59:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Creating offline snapshot ee825bdb-91cf-4841-8f4f-6a98db8b41bf of volume aa68f58c-d99c-4779-ac3f-119abac354de {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:59:35 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f67904-d89a-4856-9501-75623c619f67]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:35 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de Jul 07 17:59:35 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:36 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de" returned: 0 in 0.821s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:36 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf 1G Jul 07 17:59:36 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:37 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf 1G" returned: 0 in 0.986s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa68f58c-d99c-4779-ac3f-119abac354de -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:37 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa68f58c-d99c-4779-ac3f-119abac354de -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf Jul 07 17:59:37 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:38 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa68f58c-d99c-4779-ac3f-119abac354de -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf" returned: 0 in 1.013s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:38 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf is being set with open permissions: ugo+rw Jul 07 17:59:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:38 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf Jul 07 17:59:38 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:38 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf" returned: 0 in 0.829s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:38 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.info Jul 07 17:59:38 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.info" returned: 0 in 0.813s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:39 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.info is being set with open permissions: ugo+rw Jul 07 17:59:39 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:39 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.info Jul 07 17:59:39 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:40 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.info" returned: 0 in 0.769s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.358s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:40 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-002f1436-d290-4222-a086-35981b1080b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Create snapshot completed successfully Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "cinder-ee825bdb-91cf-4841-8f4f-6a98db8b41bf-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-ee825bdb-91cf-4841-8f4f-6a98db8b41bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "cinder-quobyte-aa68f58c-d99c-4779-ac3f-119abac354de" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-quobyte-aa68f58c-d99c-4779-ac3f-119abac354de" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "cinder-quobyte-ee825bdb-91cf-4841-8f4f-6a98db8b41bf" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-quobyte-ee825bdb-91cf-4841-8f4f-6a98db8b41bf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Deleting offline snapshot ee825bdb-91cf-4841-8f4f-6a98db8b41bf of volume aa68f58c-d99c-4779-ac3f-119abac354de {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] snapshot_file for this snap is: volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0d33c7-dd8c-4507-aeaa-c491aecfb247]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:42 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf Jul 07 17:59:42 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:43 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf" returned: 0 in 0.919s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa68f58c-d99c-4779-ac3f-119abac354de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:59:43 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ffca21-a341-40f0-a16a-ceafe3fa19ac]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:43 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de Jul 07 17:59:43 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:44 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de" returned: 0 in 1.139s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:44 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf Jul 07 17:59:44 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:45 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf" returned: 0 in 1.231s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:45 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf Jul 07 17:59:45 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:46 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de.ee825bdb-91cf-4841-8f4f-6a98db8b41bf" returned: 0 in 1.327s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-quobyte-ee825bdb-91cf-4841-8f4f-6a98db8b41bf" released by "_delete_snapshot" :: held 4.876s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-quobyte-aa68f58c-d99c-4779-ac3f-119abac354de" released by "delete_snapshot" :: held 4.919s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:47 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Created reservations ['db70b259-51b8-4b99-8ba8-63d861334a71', 'e418a4f5-505f-4542-8b7a-b424655f3458', '19ade43a-31d7-4bf6-8f05-3d35fc228f00', '9906417d-e929-46ae-99ec-c7e065f1738f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:47 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Delete snapshot completed successfully. Jul 07 17:59:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3f632821-d20f-4ddd-9bbe-e98db92e107e tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-ee825bdb-91cf-4841-8f4f-6a98db8b41bf-delete_snapshot" released by "delete_snapshot" :: held 5.147s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "cinder-aa68f58c-d99c-4779-ac3f-119abac354de-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-aa68f58c-d99c-4779-ac3f-119abac354de-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "cinder-quobyte-aa68f58c-d99c-4779-ac3f-119abac354de" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-quobyte-aa68f58c-d99c-4779-ac3f-119abac354de" acquired by "delete_volume" :: waited 0.046s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa753cb-245e-46f9-bf73-b7337bd1cd6f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:48 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de Jul 07 17:59:48 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:49 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de" returned: 0 in 1.199s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:49 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de Jul 07 17:59:49 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:49 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-aa68f58c-d99c-4779-ac3f-119abac354de" returned: 0 in 0.741s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-quobyte-aa68f58c-d99c-4779-ac3f-119abac354de" released by "delete_volume" :: held 2.099s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:50 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Created reservations ['714071e4-9ba0-4ba1-83a9-a03a9cbe7153', 'be3f0474-af66-4a1b-b5ff-d603dc927c0e', '9f5d6b34-1ab1-4f03-9ff5-2dffa3b46161', '6308d446-ee22-4da4-a760-617c0f313c3d'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:50 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 17:59:50 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:50 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.810s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:51 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Deleted volume successfully. Jul 07 17:59:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2bdacea3-b366-43b5-a776-587a33e796de tempest-VolumeSnapshotQuotasNegativeTestJSON-612845473 None] Lock "cinder-aa68f58c-d99c-4779-ac3f-119abac354de-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-124f53cc-f2f9-4a03-b412-5b86b19fe61b tempest-VolumesActionsTest-760088134 None] Acquiring lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" by "attach_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-124f53cc-f2f9-4a03-b412-5b86b19fe61b tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" acquired by "attach_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-124f53cc-f2f9-4a03-b412-5b86b19fe61b tempest-VolumesActionsTest-760088134 None] Attaching volume 28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 to instance 0ac4290c-6326-4002-9a22-3024b56449b1 at mountpoint /dev/vdb on host None. Jul 07 17:59:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-124f53cc-f2f9-4a03-b412-5b86b19fe61b tempest-VolumesActionsTest-760088134 None] Attach volume completed successfully. Jul 07 17:59:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-124f53cc-f2f9-4a03-b412-5b86b19fe61b tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" released by "attach_volume" :: held 0.224s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0b6c9bad-238c-49de-a2f1-8353c2c62fa8 tempest-VolumesActionsTest-760088134 None] Acquiring lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-detach_volume" by "detach_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0b6c9bad-238c-49de-a2f1-8353c2c62fa8 tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0b6c9bad-238c-49de-a2f1-8353c2c62fa8 tempest-VolumesActionsTest-760088134 None] Detaching volume 28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 from instance 0ac4290c-6326-4002-9a22-3024b56449b1. Jul 07 17:59:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0b6c9bad-238c-49de-a2f1-8353c2c62fa8 tempest-VolumesActionsTest-760088134 None] Detach volume completed successfully. Jul 07 17:59:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0b6c9bad-238c-49de-a2f1-8353c2c62fa8 tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Flow 'volume_create_manager' (f6215a51-3281-4fe1-b84f-3e72670535af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83f820e-8319-4592-9d5d-d64a45ab3c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83f820e-8319-4592-9d5d-d64a45ab3c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-85924577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de52f33-a792-4dde-9a5a-e3e554860e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587b3af2fc841a8b1977532e0194273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:01Z,use_quota=True,user_id='ec804deff2904e12b01ba7a70020f312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c7255a-34c0-453e-a97f-38de6e5607da),volume_type_id=c8c7255a-34c0-453e-a97f-38de6e5607da)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f48a560-284f-42a8-829e-343da94f03bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f48a560-284f-42a8-829e-343da94f03bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1caffd6-15d1-471d-b45b-4a96973813f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1caffd6-15d1-471d-b45b-4a96973813f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de52f33-a792-4dde-9a5a-e3e554860e9e', 'volume_name': 'volume-1de52f33-a792-4dde-9a5a-e3e554860e9e', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a351a8-f69b-4608-aa23-ec1546050aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a351a8-f69b-4608-aa23-ec1546050aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354ed999-1c8d-42d9-8192-f32e690dadbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:00 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Volume 1de52f33-a792-4dde-9a5a-e3e554860e9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de52f33-a792-4dde-9a5a-e3e554860e9e', 'volume_size': 1} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-85924577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de52f33-a792-4dde-9a5a-e3e554860e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587b3af2fc841a8b1977532e0194273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:01Z,use_quota=True,user_id='ec804deff2904e12b01ba7a70020f312',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c7255a-34c0-453e-a97f-38de6e5607da),volume_type_id=c8c7255a-34c0-453e-a97f-38de6e5607da)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Creating volume 1de52f33-a792-4dde-9a5a-e3e554860e9e {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:00 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:00:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:00 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e 1073741824 Jul 07 18:00:00 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:02 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e 1073741824" returned: 0 in 1.190s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:02 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e Jul 07 18:00:02 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:03 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e" returned: 0 in 1.128s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:00:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.457s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354ed999-1c8d-42d9-8192-f32e690dadbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de52f33-a792-4dde-9a5a-e3e554860e9e', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bc5d2e-0718-4669-8372-b53b75fa1fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:03 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Volume volume-1de52f33-a792-4dde-9a5a-e3e554860e9e (1de52f33-a792-4dde-9a5a-e3e554860e9e): created successfully Jul 07 18:00:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bc5d2e-0718-4669-8372-b53b75fa1fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Flow 'volume_create_manager' (f6215a51-3281-4fe1-b84f-3e72670535af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1bc56670-3326-404a-949f-da9798fa9a26 tempest-VolumeTypesAccessTest-1938052165 None] Created volume successfully. Jul 07 18:00:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Acquiring lock "cinder-1de52f33-a792-4dde-9a5a-e3e554860e9e-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Lock "cinder-1de52f33-a792-4dde-9a5a-e3e554860e9e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Acquiring lock "cinder-quobyte-1de52f33-a792-4dde-9a5a-e3e554860e9e" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Lock "cinder-quobyte-1de52f33-a792-4dde-9a5a-e3e554860e9e" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6743cf7b-b86a-4a65-95dc-7f594d967feb]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:04 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e Jul 07 18:00:04 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:05 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e" returned: 0 in 1.011s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:05 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e Jul 07 18:00:05 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Flow 'volume_create_manager' (685764e4-9d0f-4380-a9f0-665eb8034108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfb30cc-933d-4e96-8302-3551a0c5bc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfb30cc-933d-4e96-8302-3551a0c5bc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-128533262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8681313-b4fb-4bed-bd1f-db6cb3aca501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86604abf358c47cca065bd858eb62c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:06Z,use_quota=True,user_id='86bdfaaa73e144359e988a68dc39029e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd70376-d311-4d2e-88ba-e2fec10f7353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd70376-d311-4d2e-88ba-e2fec10f7353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4920299-9b4b-4d55-9d7c-e636306151ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4920299-9b4b-4d55-9d7c-e636306151ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8681313-b4fb-4bed-bd1f-db6cb3aca501', 'volume_name': 'volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c162fc7-95ac-49f9-957c-cc38c2f08b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c162fc7-95ac-49f9-957c-cc38c2f08b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6323a648-44d4-42b6-9062-ac2d4ee14bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:05 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Volume e8681313-b4fb-4bed-bd1f-db6cb3aca501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501', 'volume_size': 1} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-128533262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8681313-b4fb-4bed-bd1f-db6cb3aca501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86604abf358c47cca065bd858eb62c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:06Z,use_quota=True,user_id='86bdfaaa73e144359e988a68dc39029e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Creating volume e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:05 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:00:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:05 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 1073741824 Jul 07 18:00:05 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:06 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-1de52f33-a792-4dde-9a5a-e3e554860e9e" returned: 0 in 0.726s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Lock "cinder-quobyte-1de52f33-a792-4dde-9a5a-e3e554860e9e" released by "delete_volume" :: held 1.797s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:06 devstack cinder-volume[87228]: WARNING cinder.quota [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1594903862 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1594903862, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:00:06 devstack cinder-volume[87228]: WARNING cinder.quota [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1594903862 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1594903862, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Created reservations ['a2242110-540d-46d0-af65-b533e5d576f6', '41cafade-a476-4d15-8188-5ccd98c0785e', 'ddc56d0d-47a0-4586-8248-034ab422c9ed', '4d97c27d-b1e0-42d1-ad3c-7f867997ef5a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:06 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:00:06 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:07 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.970s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:07 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:00:07 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Deleted volume successfully. Jul 07 18:00:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 1073741824" returned: 0 in 1.252s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-035308a9-0291-4a08-a4e7-5ebb5ea46dd0 tempest-VolumeTypesAccessTest-1938052165 None] Lock "cinder-1de52f33-a792-4dde-9a5a-e3e554860e9e-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:07 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 Jul 07 18:00:07 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:08 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501" returned: 0 in 0.793s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:00:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6323a648-44d4-42b6-9062-ac2d4ee14bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af5658a-4b82-40ed-a177-9c22489259c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:08 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Volume volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 (e8681313-b4fb-4bed-bd1f-db6cb3aca501): created successfully Jul 07 18:00:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af5658a-4b82-40ed-a177-9c22489259c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Flow 'volume_create_manager' (685764e4-9d0f-4380-a9f0-665eb8034108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=87,cinder:DELETE=8,cinder:UPDATE=100,cinder:INSERT=25 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:00:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9498c013-4ddd-401a-898b-bbf3bc3c5ce6 tempest-SnapshotDependencyTests-631046911 None] Created volume successfully. Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=111,cinder:DELETE=12,cinder:SELECT=75,cinder:INSERT=25 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Acquiring lock "cinder-9fcada84-d23f-4c0b-828b-9a89e976f1f6-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Creating offline snapshot 92a1e9ac-9065-4b32-8db3-26045fa71050 of volume e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Lock "cinder-9fcada84-d23f-4c0b-828b-9a89e976f1f6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64a3449-687d-4ca9-bfc2-1ae026f91da9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Acquiring lock "cinder-quobyte-9fcada84-d23f-4c0b-828b-9a89e976f1f6" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Lock "cinder-quobyte-9fcada84-d23f-4c0b-828b-9a89e976f1f6" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[328a5103-f85d-4bad-a470-a3befab9d3e1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:09 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 Jul 07 18:00:09 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:09 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 Jul 07 18:00:09 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:10 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501" returned: 0 in 0.939s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:10 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 1G Jul 07 18:00:10 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:10 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6" returned: 0 in 0.863s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:10 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6 Jul 07 18:00:10 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:11 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9fcada84-d23f-4c0b-828b-9a89e976f1f6" returned: 0 in 0.687s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Lock "cinder-quobyte-9fcada84-d23f-4c0b-828b-9a89e976f1f6" released by "delete_volume" :: held 1.599s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Created reservations ['385a0b5b-3fdf-465c-bb1a-8aa566fc6f83', '22f2b85c-032e-410f-a1b7-c46fa27bdf50', '4e83604d-32f3-43ff-ab5c-1ba83833f900', '5a208d71-13a0-40c5-9fa5-bb232cb07ad2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:11 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 1G" returned: 0 in 0.894s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:11 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:00:11 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:11 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 Jul 07 18:00:11 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:12 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050" returned: 0 in 0.765s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:12 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 is being set with open permissions: ugo+rw Jul 07 18:00:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:12 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.799s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:12 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:00:12 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Deleted volume successfully. Jul 07 18:00:12 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 Jul 07 18:00:12 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c6b68be1-25a9-4660-8aad-e458ded29c02 tempest-VolumesNegativeTest-160881662 None] Lock "cinder-9fcada84-d23f-4c0b-828b-9a89e976f1f6-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:12 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050" returned: 0 in 0.709s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:12 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.info Jul 07 18:00:12 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:13 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.info" returned: 0 in 0.654s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:13 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.info is being set with open permissions: ugo+rw Jul 07 18:00:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:13 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.info Jul 07 18:00:13 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:14 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.info" returned: 0 in 0.654s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.770s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.631s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2536273a-ad50-4537-a0c0-5873cfa0e0c0]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3d55ec46-7a80-4169-8d36-668836528a32 tempest-SnapshotDependencyTests-631046911 None] Create snapshot completed successfully Jul 07 18:00:14 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 18:00:14 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Flow 'volume_create_manager' (7565af71-a099-49b1-ad0e-8d6f545ea923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c798d370-cd9d-4a67-8579-21ccaf7ce955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c798d370-cd9d-4a67-8579-21ccaf7ce955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-916336435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d67f3a-5bad-4fa9-8683-2a80760b16aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc5e99f52d34296836e15ffa1fa2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:15Z,use_quota=True,user_id='28c7575fadf145c1bc57d65fecf7912d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cac30c-cb75-4e62-9695-cad8a01e983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59cac30c-cb75-4e62-9695-cad8a01e983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5b0fe0-6555-4690-9061-5cf3b2965f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5b0fe0-6555-4690-9061-5cf3b2965f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d67f3a-5bad-4fa9-8683-2a80760b16aa', 'volume_name': 'volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39082c21-905e-4351-9ab4-3e13f99a82c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39082c21-905e-4351-9ab4-3e13f99a82c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aba969d-587a-4c28-b5a3-2c12e003fc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:14 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Volume b2d67f3a-5bad-4fa9-8683-2a80760b16aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa', 'volume_size': 1} Jul 07 18:00:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:15 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.987s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6657c3dd-3e2c-4103-b9bf-16d55d709e44]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Flow 'volume_create_manager' (24bd7e1a-ccc0-45a0-abac-59a455ca7030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecaf781-59c5-4496-934c-2489370a5cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:15 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 18:00:15 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecaf781-59c5-4496-934c-2489370a5cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52481197-bcca-45c3-9b0b-d1b319ad5b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86604abf358c47cca065bd858eb62c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92a1e9ac-9065-4b32-8db3-26045fa71050,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:15Z,use_quota=True,user_id='86bdfaaa73e144359e988a68dc39029e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d5220c-55e6-4c56-8f55-3f9968554bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d5220c-55e6-4c56-8f55-3f9968554bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39548fe9-89f5-476d-ba91-c2e783cfcca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39548fe9-89f5-476d-ba91-c2e783cfcca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52481197-bcca-45c3-9b0b-d1b319ad5b0d', 'volume_name': 'volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d', 'volume_size': 1, 'snapshot_id': '92a1e9ac-9065-4b32-8db3-26045fa71050'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330b1218-59f6-4806-82b0-f056adcbf795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330b1218-59f6-4806-82b0-f056adcbf795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba7a341-2e6d-43a6-95e3-5655fe267fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Volume 52481197-bcca-45c3-9b0b-d1b319ad5b0d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d', 'volume_size': 1, 'snapshot_id': '92a1e9ac-9065-4b32-8db3-26045fa71050'} Jul 07 18:00:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:16 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.815s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.681b8c5b-b4db-4469-bb50-88dc98ab9960xp9vdt50.img {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:16 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.681b8c5b-b4db-4469-bb50-88dc98ab9960xp9vdt50.img Jul 07 18:00:16 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:20 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.681b8c5b-b4db-4469-bb50-88dc98ab9960xp9vdt50.img" returned: 0 in 4.750s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dabd59-3ea9-4f87-83b1-85b9cade3f1f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:20 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 18:00:20 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:21 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.914s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:21 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.681b8c5b-b4db-4469-bb50-88dc98ab9960xp9vdt50.img {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:00:21 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Converted 1024.00 MB image at 215.53 MB/s Jul 07 18:00:21 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] 681b8c5b-b4db-4469-bb50-88dc98ab9960 was raw, no need to convert to raw {{(pid=87228) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Flow 'volume_create_manager' (bdcc7336-b7c9-473d-8a56-a4d1e2ea29f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef921fa-9470-41fb-89f9-3581f2653985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef921fa-9470-41fb-89f9-3581f2653985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-120128150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0af041-e643-46f1-b80d-c6fc1ae5da76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c12639c9e9466f86f632a87676f91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:22Z,use_quota=True,user_id='143907dfc2314d1c8150e6fc6262385c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fea2077-35b1-449d-b664-0f1b2c3ad523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fea2077-35b1-449d-b664-0f1b2c3ad523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fae777-ead2-4df5-b6bb-273509a59259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fae777-ead2-4df5-b6bb-273509a59259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0af041-e643-46f1-b80d-c6fc1ae5da76', 'volume_name': 'volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e52e74-10ab-47b6-8156-7f07f9fcb7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e52e74-10ab-47b6-8156-7f07f9fcb7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba91252-f0b6-481d-a469-7b64a03fd785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:22 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Volume 9b0af041-e643-46f1-b80d-c6fc1ae5da76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76', 'volume_size': 1} Jul 07 18:00:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:00:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:23 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:00:23 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:24 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.650s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:00:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:00:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:00:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:00:32 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=13 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:00:32 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=17,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.168s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Uploaded volume to glance image-id: 681b8c5b-b4db-4469-bb50-88dc98ab9960. {{(pid=87228) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.508s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-916336435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d67f3a-5bad-4fa9-8683-2a80760b16aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc5e99f52d34296836e15ffa1fa2bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:15Z,use_quota=True,user_id='28c7575fadf145c1bc57d65fecf7912d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Creating volume b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:40 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:00:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:40 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa 1073741824 Jul 07 18:00:40 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:40 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b24953e6-0b05-4161-addb-32916dddbb6c tempest-VolumesActionsTest-760088134 None] Copy volume to image completed successfully. Jul 07 18:00:41 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa 1073741824" returned: 0 in 0.856s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:41 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa Jul 07 18:00:41 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:41 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" returned: 0 in 0.642s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 26.495s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-quobyte-92a1e9ac-9065-4b32-8db3-26045fa71050-52481197-bcca-45c3-9b0b-d1b319ad5b0d" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aba969d-587a-4c28-b5a3-2c12e003fc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca95a0c-3151-4e25-b17c-3ba2971e1fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-92a1e9ac-9065-4b32-8db3-26045fa71050-52481197-bcca-45c3-9b0b-d1b319ad5b0d" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Creating volume 52481197-bcca-45c3-9b0b-d1b319ad5b0d from snapshot 92a1e9ac-9065-4b32-8db3-26045fa71050 {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-quobyte-52481197-bcca-45c3-9b0b-d1b319ad5b0d" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:42 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Volume volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa (b2d67f3a-5bad-4fa9-8683-2a80760b16aa): created successfully Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca95a0c-3151-4e25-b17c-3ba2971e1fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Flow 'volume_create_manager' (7565af71-a099-49b1-ad0e-8d6f545ea923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-52481197-bcca-45c3-9b0b-d1b319ad5b0d" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] snapshot: 92a1e9ac-9065-4b32-8db3-26045fa71050, volume: 52481197-bcca-45c3-9b0b-d1b319ad5b0d, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:00:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f64fb8ec-6323-4e24-92f4-76dfbfc08efd tempest-VolumesSnapshotListTestJSON-319818728 None] Created volume successfully. Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d10de-a399-4110-9797-8590ba52fd8b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:42 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 Jul 07 18:00:42 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:42 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050" returned: 0 in 0.730s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd020ba3-085c-45d7-9019-8df46bece9b5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:42 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 Jul 07 18:00:42 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:43 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501" returned: 0 in 0.732s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:43 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:00:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:43 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d Jul 07 18:00:43 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:47 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d" returned: 0 in 4.243s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:47 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace19f6b-4642-4577-b1b7-316f4f880ea7]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:47 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 Jul 07 18:00:47 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:48 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501" returned: 0 in 0.864s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:48 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:00:48 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Converted 1024.00 MB image at 241.27 MB/s Jul 07 18:00:48 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d is being set with open permissions: ugo+rw Jul 07 18:00:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:48 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d Jul 07 18:00:48 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:49 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d" returned: 0 in 0.596s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-52481197-bcca-45c3-9b0b-d1b319ad5b0d" released by "_copy_volume_from_snapshot" :: held 7.259s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-92a1e9ac-9065-4b32-8db3-26045fa71050-52481197-bcca-45c3-9b0b-d1b319ad5b0d" released by "_create_volume_from_snapshot" :: held 7.301s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.334s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.746s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-120128150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0af041-e643-46f1-b80d-c6fc1ae5da76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c12639c9e9466f86f632a87676f91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:22Z,use_quota=True,user_id='143907dfc2314d1c8150e6fc6262385c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Creating volume 9b0af041-e643-46f1-b80d-c6fc1ae5da76 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:49 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:49 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 1073741824 Jul 07 18:00:49 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ba7a341-2e6d-43a6-95e3-5655fe267fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d', 'volume_size': 1, 'snapshot_id': '92a1e9ac-9065-4b32-8db3-26045fa71050'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c6ee0e-6db2-4726-a9bb-561ee22c8b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:49 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Volume volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d (52481197-bcca-45c3-9b0b-d1b319ad5b0d): created successfully Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c6ee0e-6db2-4726-a9bb-561ee22c8b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Flow 'volume_create_manager' (24bd7e1a-ccc0-45a0-abac-59a455ca7030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b8a8a581-f918-4660-a4b7-a941e6da588f tempest-SnapshotDependencyTests-631046911 None] Created volume successfully. Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-92a1e9ac-9065-4b32-8db3-26045fa71050-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-92a1e9ac-9065-4b32-8db3-26045fa71050-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-quobyte-e8681313-b4fb-4bed-bd1f-db6cb3aca501" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-e8681313-b4fb-4bed-bd1f-db6cb3aca501" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-quobyte-92a1e9ac-9065-4b32-8db3-26045fa71050" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-92a1e9ac-9065-4b32-8db3-26045fa71050" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Deleting offline snapshot 92a1e9ac-9065-4b32-8db3-26045fa71050 of volume e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] snapshot_file for this snap is: volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b157657-5fda-4c57-9e46-5ba71dc72671]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:50 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 Jul 07 18:00:50 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:50 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 1073741824" returned: 0 in 0.829s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:50 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 Jul 07 18:00:50 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:50 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050" returned: 0 in 0.713s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[980655bf-21bf-4d86-928e-78e264686125]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:50 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 Jul 07 18:00:50 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:50 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76" returned: 0 in 0.614s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 9.075s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca784da3-2fca-4181-aa22-da35818d2c63]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba91252-f0b6-481d-a469-7b64a03fd785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03090141-07b4-49dd-8a28-5cb42496aa66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:50 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Volume volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 (9b0af041-e643-46f1-b80d-c6fc1ae5da76): created successfully Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03090141-07b4-49dd-8a28-5cb42496aa66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Flow 'volume_create_manager' (bdcc7336-b7c9-473d-8a56-a4d1e2ea29f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a7c3a3df-a0b2-490a-85e4-d4b149e30ee1 tempest-VolumesListAdminTestJSON-565860381 None] Created volume successfully. Jul 07 18:00:50 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 18:00:50 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:51 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501" returned: 0 in 0.760s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:51 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 Jul 07 18:00:51 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:51 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.807s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c4dc0-8890-4216-901c-8e7bba8ba765]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:51 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 18:00:51 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Flow 'volume_create_manager' (a1225ec8-e36e-4a34-b6f7-594dc476105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726b4dea-0090-4ec1-9228-e47bcede6166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726b4dea-0090-4ec1-9228-e47bcede6166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705167490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286d0c4f-831b-433f-9242-7588ee493cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c12639c9e9466f86f632a87676f91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:52Z,use_quota=True,user_id='143907dfc2314d1c8150e6fc6262385c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06388e33-45a9-4406-b02b-db7610348f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06388e33-45a9-4406-b02b-db7610348f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11ddb9f-9da9-41cf-810e-20f3e2791eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11ddb9f-9da9-41cf-810e-20f3e2791eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286d0c4f-831b-433f-9242-7588ee493cdc', 'volume_name': 'volume-286d0c4f-831b-433f-9242-7588ee493cdc', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccf34ad-e8d5-4665-9fec-5a28fc161203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccf34ad-e8d5-4665-9fec-5a28fc161203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7e19e5-5c43-4119-aaad-1868e32825c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:52 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Volume 286d0c4f-831b-433f-9242-7588ee493cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286d0c4f-831b-433f-9242-7588ee493cdc', 'volume_size': 1} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:52 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050" returned: 0 in 0.708s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:52 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050 Jul 07 18:00:52 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:52 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.822s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:52 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img Jul 07 18:00:52 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:52 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501.92a1e9ac-9065-4b32-8db3-26045fa71050" returned: 0 in 0.603s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-92a1e9ac-9065-4b32-8db3-26045fa71050" released by "_delete_snapshot" :: held 2.880s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-e8681313-b4fb-4bed-bd1f-db6cb3aca501" released by "delete_snapshot" :: held 2.910s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Created reservations ['78a70f3a-cca2-43f3-9c60-480f88495894', 'abe495ab-f79d-42b8-869d-381d752a04c4', '5caf0a34-afee-4b56-abc3-6756d53917d0', 'e70f9213-717b-4538-a754-458d88565c58'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:52 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Delete snapshot completed successfully. Jul 07 18:00:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5bacb93-de5f-4986-84a2-76433c38cb26 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-92a1e9ac-9065-4b32-8db3-26045fa71050-delete_snapshot" released by "delete_snapshot" :: held 3.060s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-e8681313-b4fb-4bed-bd1f-db6cb3aca501-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-e8681313-b4fb-4bed-bd1f-db6cb3aca501-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-quobyte-e8681313-b4fb-4bed-bd1f-db6cb3aca501" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-e8681313-b4fb-4bed-bd1f-db6cb3aca501" acquired by "delete_volume" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[861a8cda-c175-4caf-9a8f-5a2a1ba11b43]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:53 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 Jul 07 18:00:53 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:55 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501" returned: 0 in 1.805s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:55 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501 Jul 07 18:00:55 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:56 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e8681313-b4fb-4bed-bd1f-db6cb3aca501" returned: 0 in 1.497s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-e8681313-b4fb-4bed-bd1f-db6cb3aca501" released by "delete_volume" :: held 3.423s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Created reservations ['02180427-ed66-439e-9bfe-b66c6f272729', 'd0b956db-f0f1-4569-b980-253d580662fd', '172d966f-dac2-41cf-bed5-d807b6bad5cf', 'cd70e2c4-2426-4750-9273-a4fee7d4a90f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:56 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:00:56 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:57 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img" returned: 0 in 4.787s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb18fe8-c198-4a48-90ff-21549134b1a0]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:57 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 18:00:57 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:57 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.771s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:00:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Deleted volume successfully. Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc60499a-acf7-47e5-afb2-d46cbb0c6837 tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-e8681313-b4fb-4bed-bd1f-db6cb3aca501-delete_volume" released by "delete_volume" :: held 4.599s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-52481197-bcca-45c3-9b0b-d1b319ad5b0d-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-52481197-bcca-45c3-9b0b-d1b319ad5b0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "cinder-quobyte-52481197-bcca-45c3-9b0b-d1b319ad5b0d" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-52481197-bcca-45c3-9b0b-d1b319ad5b0d" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d830cf4-3012-442f-9250-7d8af462b14b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:58 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d Jul 07 18:00:58 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:58 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.933s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:00:58 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Converted 1024.00 MB image at 213.86 MB/s Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] 4762e29e-e401-45c2-ab57-32334b9fff07 was raw, converting to qcow2 {{(pid=87228) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[96438a60-b6c4-46e4-880b-9237c228548d]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:58 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img Jul 07 18:00:58 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:58 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d" returned: 0 in 0.724s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:58 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d Jul 07 18:00:58 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:58 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img" returned: 0 in 0.678s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:59 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img Jul 07 18:00:59 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:59 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-52481197-bcca-45c3-9b0b-d1b319ad5b0d" returned: 0 in 0.620s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-quobyte-52481197-bcca-45c3-9b0b-d1b319ad5b0d" released by "delete_volume" :: held 1.382s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Created reservations ['b8823bd5-fbf0-402a-b38d-92490e4da231', 'af362d9d-5ef7-40fa-9b2d-100f85374f51', '94c8fe48-6802-48ab-a681-dfd2a79ec878', 'd6926ec4-3f9a-44f3-b092-b539f03d774c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:59 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:00:59 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:59 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img" returned: 1 in 0.699s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:00:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img /opt/stack/data/cinder/conversion/vol_upload_vy7thqqj {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:59 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img /opt/stack/data/cinder/conversion/vol_upload_vy7thqqj Jul 07 18:00:59 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:00 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.661s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:00 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Deleted volume successfully. Jul 07 18:01:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-51f94451-653f-4a20-ac46-8ec58993266e tempest-SnapshotDependencyTests-631046911 None] Lock "cinder-52481197-bcca-45c3-9b0b-d1b319ad5b0d-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:00 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img /opt/stack/data/cinder/conversion/vol_upload_vy7thqqj" returned: 0 in 0.647s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:00 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Image conversion details: src /opt/stack/data/cinder/conversion/28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4.temp_image.4762e29e-e401-45c2-ab57-32334b9fff07rrcsyy_7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vy7thqqj {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:01:00 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 18:01:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72de453-90be-4d9b-9452-a36c6a4df917]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy7thqqj {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:00 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy7thqqj Jul 07 18:01:00 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:01 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vy7thqqj" returned: 0 in 0.735s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.532s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Uploaded volume to glance image-id: 4762e29e-e401-45c2-ab57-32334b9fff07. {{(pid=87228) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jul 07 18:01:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 19.372s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Creating offline snapshot b0cae644-07b4-4408-89f9-c4163dc62ec1 of volume b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:02 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-716cee27-4d38-43fe-a27d-dddc8ca6d152 tempest-VolumesActionsTest-760088134 None] Copy volume to image completed successfully. Jul 07 18:01:02 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfd042c-a63e-4e3d-94e8-dc544b201b8b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:02 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa Jul 07 18:01:02 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:03 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" returned: 0 in 0.850s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:03 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 1G Jul 07 18:01:03 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Acquiring lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Acquiring lock "cinder-quobyte-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Lock "cinder-quobyte-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:03 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b14f573-1748-4ace-86ca-508632c2e7a4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:03 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 18:01:03 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:04 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 1G" returned: 0 in 0.957s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:04 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 Jul 07 18:01:04 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:04 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.833s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:04 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4 Jul 07 18:01:04 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:04 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1" returned: 0 in 0.720s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:04 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 is being set with open permissions: ugo+rw Jul 07 18:01:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:04 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 Jul 07 18:01:04 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:05 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" returned: 0 in 0.696s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Lock "cinder-quobyte-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4" released by "delete_volume" :: held 1.580s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Created reservations ['81f7caa7-358c-41dc-9eeb-96da5b80c825', 'f7bdb21e-585f-4325-a6fd-c6f423683fc8', '1bda8ea2-3f7e-41ce-9ef4-99d4cbe9c285', '5791cbc2-766c-4bd1-960e-abee6ea1ca3b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:05 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:05 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:05 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1" returned: 0 in 0.743s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:05 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.info Jul 07 18:01:05 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:05 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.713s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:05 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Deleted volume successfully. Jul 07 18:01:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f212faa-8ba7-4d02-a91f-5452cd3f1728 tempest-VolumesActionsTest-760088134 None] Lock "cinder-28bb0b91-63c3-492f-bbb3-e0a32ef2f8e4-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:06 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.info" returned: 0 in 0.743s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:06 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.info is being set with open permissions: ugo+rw Jul 07 18:01:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:06 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.info Jul 07 18:01:06 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:07 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.info" returned: 0 in 0.803s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.929s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.260s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705167490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286d0c4f-831b-433f-9242-7588ee493cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c12639c9e9466f86f632a87676f91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:52Z,use_quota=True,user_id='143907dfc2314d1c8150e6fc6262385c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Creating volume 286d0c4f-831b-433f-9242-7588ee493cdc {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:07 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:01:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:07 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc 1073741824 Jul 07 18:01:07 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6688ee3b-5729-4ed1-b151-5fc7baeae689 tempest-VolumesSnapshotListTestJSON-319818728 None] Create snapshot completed successfully Jul 07 18:01:08 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc 1073741824" returned: 0 in 0.888s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:08 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc Jul 07 18:01:08 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:09 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc" returned: 0 in 0.816s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.500s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Creating offline snapshot 3c729dca-5644-457e-a5d4-0b321b4821c2 of volume b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7e19e5-5c43-4119-aaad-1868e32825c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286d0c4f-831b-433f-9242-7588ee493cdc', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d252535a-e68b-4843-8e15-602d161810be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c08deeb-3fa1-49ed-a86e-92ffc1358314]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:09 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Volume volume-286d0c4f-831b-433f-9242-7588ee493cdc (286d0c4f-831b-433f-9242-7588ee493cdc): created successfully Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d252535a-e68b-4843-8e15-602d161810be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Flow 'volume_create_manager' (a1225ec8-e36e-4a34-b6f7-594dc476105a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:09 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c558d157-fa4a-4cab-b43e-407070c290f3 tempest-VolumesListAdminTestJSON-565860381 None] Created volume successfully. Jul 07 18:01:09 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 Jul 07 18:01:09 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Flow 'volume_create_manager' (a9bec77e-dd11-4e2b-b145-e77c4d384caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1abe15-1561-4435-8243-a373389e69d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1abe15-1561-4435-8243-a373389e69d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-264952363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c30bc75-c67b-495d-ba89-b2866881bb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c12639c9e9466f86f632a87676f91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:10Z,use_quota=True,user_id='143907dfc2314d1c8150e6fc6262385c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15549297-7ebe-47eb-a31b-4861f8c482b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15549297-7ebe-47eb-a31b-4861f8c482b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792929fb-9a81-4683-8d3b-ccbda9f8596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792929fb-9a81-4683-8d3b-ccbda9f8596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c30bc75-c67b-495d-ba89-b2866881bb0f', 'volume_name': 'volume-7c30bc75-c67b-495d-ba89-b2866881bb0f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0365b9c2-667a-4432-a625-524bcc204a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0365b9c2-667a-4432-a625-524bcc204a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8295cc-a4ca-499b-b34a-2f64d88e16a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:10 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Volume 7c30bc75-c67b-495d-ba89-b2866881bb0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c30bc75-c67b-495d-ba89-b2866881bb0f', 'volume_size': 1} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:10 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1" returned: 0 in 1.066s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:10 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 1G Jul 07 18:01:10 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:11 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 1G" returned: 0 in 0.895s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:11 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 Jul 07 18:01:11 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:11 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2" returned: 0 in 0.700s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:11 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 is being set with open permissions: ugo+rw Jul 07 18:01:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:11 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 Jul 07 18:01:11 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:12 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2" returned: 0 in 0.642s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.433s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-264952363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c30bc75-c67b-495d-ba89-b2866881bb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c12639c9e9466f86f632a87676f91b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:10Z,use_quota=True,user_id='143907dfc2314d1c8150e6fc6262385c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Creating volume 7c30bc75-c67b-495d-ba89-b2866881bb0f {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:12 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:01:12 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f 1073741824 Jul 07 18:01:12 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Flow 'volume_create_manager' (fc7df8a6-ae44-4a55-8a41-9b8b8f820d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee1653a-1352-4e4c-b89d-5e8f3c359c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dee1653a-1352-4e4c-b89d-5e8f3c359c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-753412287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8663234-6b52-485b-94c2-4cff4e26aebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfadf592ac7841e999ef3a116569a382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:12Z,use_quota=True,user_id='3fd0d58cf503454e902524053bef1e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774be8cf-35a5-44a0-9ade-6304f8be0805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774be8cf-35a5-44a0-9ade-6304f8be0805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363f88a3-ec14-4c6a-b2dd-75cf5f119793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363f88a3-ec14-4c6a-b2dd-75cf5f119793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8663234-6b52-485b-94c2-4cff4e26aebb', 'volume_name': 'volume-d8663234-6b52-485b-94c2-4cff4e26aebb', 'volume_size': 2}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39426fa0-689a-45d0-82c5-c01b60a35f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39426fa0-689a-45d0-82c5-c01b60a35f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3a66b9-1257-4906-8998-8906edc7f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:12 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Volume d8663234-6b52-485b-94c2-4cff4e26aebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8663234-6b52-485b-94c2-4cff4e26aebb', 'volume_size': 2} Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:12 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-22f87559-7a88-4c8f-bbcd-eb5707c55aa2 tempest-VolumesSnapshotListTestJSON-319818728 None] Create snapshot completed successfully Jul 07 18:01:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:13 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f 1073741824" returned: 0 in 0.797s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:13 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f Jul 07 18:01:13 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:13 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f" returned: 0 in 0.604s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-753412287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8663234-6b52-485b-94c2-4cff4e26aebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfadf592ac7841e999ef3a116569a382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:12Z,use_quota=True,user_id='3fd0d58cf503454e902524053bef1e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Creating volume d8663234-6b52-485b-94c2-4cff4e26aebb {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:13 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb 2147483648 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8295cc-a4ca-499b-b34a-2f64d88e16a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c30bc75-c67b-495d-ba89-b2866881bb0f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:13 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb 2147483648 Jul 07 18:01:13 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376750e9-51f2-4c1d-9c29-efa7e5e16bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:14 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Volume volume-7c30bc75-c67b-495d-ba89-b2866881bb0f (7c30bc75-c67b-495d-ba89-b2866881bb0f): created successfully Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376750e9-51f2-4c1d-9c29-efa7e5e16bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Flow 'volume_create_manager' (a9bec77e-dd11-4e2b-b145-e77c4d384caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6e52c74a-949b-43f5-8875-1e724abd0592 tempest-VolumesListAdminTestJSON-565860381 None] Created volume successfully. Jul 07 18:01:14 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb 2147483648" returned: 0 in 0.879s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:14 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb Jul 07 18:01:14 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Flow 'volume_create_manager' (01db969a-7fdc-4f35-8b65-7994d87b8909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3182276-63df-4070-922d-8917516cec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3182276-63df-4070-922d-8917516cec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82191474-f64a-425a-97c4-3dd0f66b5537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc7653ec32045c3bb90d2a2014f470a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:15Z,use_quota=True,user_id='f651921d8d144cf68dcf42d0cd7c7fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94915183-61b4-4681-923e-a3585525fe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94915183-61b4-4681-923e-a3585525fe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee25b4c1-80ca-4b0c-a7ee-bc3ad9195178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee25b4c1-80ca-4b0c-a7ee-bc3ad9195178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82191474-f64a-425a-97c4-3dd0f66b5537', 'volume_name': 'volume-82191474-f64a-425a-97c4-3dd0f66b5537', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9412ff-2f71-4272-8e19-0be20a85b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9412ff-2f71-4272-8e19-0be20a85b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afab4f88-96a5-4f55-8778-cadd9ba3a6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:14 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Volume 82191474-f64a-425a-97c4-3dd0f66b5537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82191474-f64a-425a-97c4-3dd0f66b5537', 'volume_size': 1} Jul 07 18:01:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:15 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb" returned: 0 in 0.604s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.529s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3a66b9-1257-4906-8998-8906edc7f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8663234-6b52-485b-94c2-4cff4e26aebb', 'volume_size': 2}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d61c38a-0919-4b63-91fb-e4b738d866bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Creating offline snapshot b04180c5-58d2-4b31-a5ff-cef30ebe2658 of volume b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Volume volume-d8663234-6b52-485b-94c2-4cff4e26aebb (d8663234-6b52-485b-94c2-4cff4e26aebb): created successfully Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d61c38a-0919-4b63-91fb-e4b738d866bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Flow 'volume_create_manager' (fc7df8a6-ae44-4a55-8a41-9b8b8f820d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70e794e-53cf-42f4-85d6-0371b791d993]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:15 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c9fb74fb-b27b-4928-9da8-184cb208a079 tempest-VolumesCloneNegativeTest-2111758985 None] Created volume successfully. Jul 07 18:01:15 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 Jul 07 18:01:15 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:16 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2" returned: 0 in 0.720s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:16 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 1G Jul 07 18:01:16 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Acquiring lock "cinder-d8663234-6b52-485b-94c2-4cff4e26aebb-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "cinder-d8663234-6b52-485b-94c2-4cff4e26aebb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Acquiring lock "cinder-quobyte-d8663234-6b52-485b-94c2-4cff4e26aebb" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "cinder-quobyte-d8663234-6b52-485b-94c2-4cff4e26aebb" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118c102-9035-4a7a-8309-1a1a6a4e0552]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:17 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb Jul 07 18:01:17 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:17 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 1G" returned: 0 in 0.866s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:17 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 Jul 07 18:01:17 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:17 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb" returned: 0 in 0.737s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:17 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb Jul 07 18:01:17 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:17 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658" returned: 0 in 0.677s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:17 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 is being set with open permissions: ugo+rw Jul 07 18:01:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:17 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 Jul 07 18:01:17 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:18 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d8663234-6b52-485b-94c2-4cff4e26aebb" returned: 0 in 0.633s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "cinder-quobyte-d8663234-6b52-485b-94c2-4cff4e26aebb" released by "delete_volume" :: held 1.408s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Created reservations ['8fe77a8b-b3e8-4b37-a6f6-39e27ae5cd32', 'ddc7c0e9-b9e3-4412-846b-e79ff8e38aaa', 'f217bb97-4460-4546-b244-068817f2564b', '94aadd4c-a4d8-4133-85fe-61ab879e04e1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:18 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:18 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:18 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658" returned: 0 in 0.660s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.526s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82191474-f64a-425a-97c4-3dd0f66b5537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc7653ec32045c3bb90d2a2014f470a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:15Z,use_quota=True,user_id='f651921d8d144cf68dcf42d0cd7c7fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Creating volume 82191474-f64a-425a-97c4-3dd0f66b5537 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:18 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:01:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:18 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 1073741824 Jul 07 18:01:18 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:18 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-27dc2532-5eb8-4847-87f5-c422944b2428 tempest-VolumesSnapshotListTestJSON-319818728 None] Create snapshot completed successfully Jul 07 18:01:19 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.641s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:19 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Deleted volume successfully. Jul 07 18:01:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5cdbaa76-d221-44cf-8c35-b5c6c9b56ad0 tempest-VolumesCloneNegativeTest-2111758985 None] Lock "cinder-d8663234-6b52-485b-94c2-4cff4e26aebb-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:19 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 1073741824" returned: 0 in 0.929s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:19 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 Jul 07 18:01:19 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-b04180c5-58d2-4b31-a5ff-cef30ebe2658-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-b04180c5-58d2-4b31-a5ff-cef30ebe2658-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-quobyte-b04180c5-58d2-4b31-a5ff-cef30ebe2658" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b04180c5-58d2-4b31-a5ff-cef30ebe2658" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Deleting offline snapshot b04180c5-58d2-4b31-a5ff-cef30ebe2658 of volume b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] snapshot_file for this snap is: volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6271d6-5f28-4337-9de5-2e4ed587e82a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:20 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537" returned: 0 in 0.713s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afab4f88-96a5-4f55-8778-cadd9ba3a6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82191474-f64a-425a-97c4-3dd0f66b5537', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40553c3-bfe1-4939-af85-d2c1cf0a248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:20 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Volume volume-82191474-f64a-425a-97c4-3dd0f66b5537 (82191474-f64a-425a-97c4-3dd0f66b5537): created successfully Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d40553c3-bfe1-4939-af85-d2c1cf0a248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Flow 'volume_create_manager' (01db969a-7fdc-4f35-8b65-7994d87b8909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5ca4c6ba-f6de-404b-b632-550fe7a8e6c1 tempest-VolumesListAdminTestJSON-1568769554 None] Created volume successfully. Jul 07 18:01:20 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 Jul 07 18:01:20 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:20 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658" returned: 0 in 0.785s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c9f894-6e33-4c6b-86d0-10da9c7bb9a5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:21 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 Jul 07 18:01:21 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Acquiring lock "cinder-82191474-f64a-425a-97c4-3dd0f66b5537-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "cinder-82191474-f64a-425a-97c4-3dd0f66b5537-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Acquiring lock "cinder-quobyte-82191474-f64a-425a-97c4-3dd0f66b5537" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "cinder-quobyte-82191474-f64a-425a-97c4-3dd0f66b5537" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[585bb1e4-bef3-437e-b002-d82ac75c2fdc]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "cinder-7c30bc75-c67b-495d-ba89-b2866881bb0f-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-7c30bc75-c67b-495d-ba89-b2866881bb0f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "cinder-quobyte-7c30bc75-c67b-495d-ba89-b2866881bb0f" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-quobyte-7c30bc75-c67b-495d-ba89-b2866881bb0f" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb41a71-6874-4bf9-af37-032e76420406]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:21 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 Jul 07 18:01:21 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:21 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f Jul 07 18:01:21 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:21 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2" returned: 0 in 0.839s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:21 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 Jul 07 18:01:21 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Flow 'volume_create_manager' (600c280d-e69a-4b55-9fda-d09106d5583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f051d15-2212-46b4-a81f-058065a61546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f051d15-2212-46b4-a81f-058065a61546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1916594249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6b4717-491a-4e18-b47c-d074d5753e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564fcf60ec7b484eb8f250ac85df713b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:22Z,use_quota=True,user_id='0bf7f9cf496e44e396af1348953b087e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2eb79d-bc48-49d4-8f57-046a494ecf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2eb79d-bc48-49d4-8f57-046a494ecf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:22 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9b63d7-c705-4244-a38b-0895c35c97e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9b63d7-c705-4244-a38b-0895c35c97e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b6b4717-491a-4e18-b47c-d074d5753e7e', 'volume_name': 'volume-6b6b4717-491a-4e18-b47c-d074d5753e7e', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdde550-dba2-4183-bcbc-f4907825b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdde550-dba2-4183-bcbc-f4907825b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3cc98f-435b-46e7-acdd-4d3577cbb723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:22 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Volume 6b6b4717-491a-4e18-b47c-d074d5753e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b6b4717-491a-4e18-b47c-d074d5753e7e', 'volume_size': 1} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1916594249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6b4717-491a-4e18-b47c-d074d5753e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564fcf60ec7b484eb8f250ac85df713b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:22Z,use_quota=True,user_id='0bf7f9cf496e44e396af1348953b087e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Creating volume 6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:22 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537" returned: 0 in 1.008s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:22 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e 1073741824 Jul 07 18:01:22 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:22 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537 Jul 07 18:01:22 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:22 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f" returned: 0 in 0.987s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:22 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f Jul 07 18:01:22 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:22 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658" returned: 0 in 1.003s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:22 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658 Jul 07 18:01:22 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:23 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-82191474-f64a-425a-97c4-3dd0f66b5537" returned: 0 in 0.716s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "cinder-quobyte-82191474-f64a-425a-97c4-3dd0f66b5537" released by "delete_volume" :: held 1.781s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Created reservations ['fdda8e2e-2e77-48ff-9797-5adc69b59d17', '5b8b9ce8-9e25-4fc1-81f9-afb38144859f', 'e02f10c0-8310-4872-99f7-c71d193cfa91', '9367126c-0165-4e36-b3ce-3f6cebf742db'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:23 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7c30bc75-c67b-495d-ba89-b2866881bb0f" returned: 0 in 0.728s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-quobyte-7c30bc75-c67b-495d-ba89-b2866881bb0f" released by "delete_volume" :: held 1.768s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:23 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e 1073741824" returned: 0 in 0.969s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:23 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:23 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Created reservations ['18b2915f-2703-4a73-8b2b-da0a16e046fe', '3baf01c3-d622-4612-a76f-852733bf4ba2', '11f78229-0b66-4fc1-b361-5d7fa2279126', '4e0506d3-7789-42e7-840a-6063d874100c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:23 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e Jul 07 18:01:23 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:23 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b04180c5-58d2-4b31-a5ff-cef30ebe2658" returned: 0 in 0.764s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b04180c5-58d2-4b31-a5ff-cef30ebe2658" released by "_delete_snapshot" :: held 3.514s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" released by "delete_snapshot" :: held 3.537s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:23 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:23 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Created reservations ['e3e7d2ab-e3fb-4857-ab41-e362c753385a', '22d65910-ed3d-494d-bdce-a901c123058a', '999fdf21-b3c9-4597-b6a8-01ba4d477ac1', 'fd0fcabd-83eb-45c1-afe9-e1c1aaeed93c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:23 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:23 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Delete snapshot completed successfully. Jul 07 18:01:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e6efd91a-b387-4804-ae02-0cee56e97344 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-b04180c5-58d2-4b31-a5ff-cef30ebe2658-delete_snapshot" released by "delete_snapshot" :: held 3.869s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "cinder-286d0c4f-831b-433f-9242-7588ee493cdc-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-286d0c4f-831b-433f-9242-7588ee493cdc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "cinder-quobyte-286d0c4f-831b-433f-9242-7588ee493cdc" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-quobyte-286d0c4f-831b-433f-9242-7588ee493cdc" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d93819c-2743-467b-9a89-71fe347eac2a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:24 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc Jul 07 18:01:24 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-3c729dca-5644-457e-a5d4-0b321b4821c2-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:24 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e" returned: 0 in 0.967s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-3c729dca-5644-457e-a5d4-0b321b4821c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3cc98f-435b-46e7-acdd-4d3577cbb723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6b4717-491a-4e18-b47c-d074d5753e7e', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e05579-028a-4fab-858a-6e7d4e085698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-quobyte-3c729dca-5644-457e-a5d4-0b321b4821c2" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:24 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:24 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Volume volume-6b6b4717-491a-4e18-b47c-d074d5753e7e (6b6b4717-491a-4e18-b47c-d074d5753e7e): created successfully Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e05579-028a-4fab-858a-6e7d4e085698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Flow 'volume_create_manager' (600c280d-e69a-4b55-9fda-d09106d5583e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.118s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-3c729dca-5644-457e-a5d4-0b321b4821c2" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Deleting offline snapshot 3c729dca-5644-457e-a5d4-0b321b4821c2 of volume b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] snapshot_file for this snap is: volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Deleted volume successfully. Jul 07 18:01:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c3bd392b-5f93-4806-b18b-0e19f6e0d1ac tempest-VolumeDependencyTests-1399176668 None] Created volume successfully. Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4031e95-7436-4c69-adcf-c58e1ac63e0a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:24 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.047s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ef9e61d7-4f93-47ec-9917-318457a4f204 tempest-VolumesListAdminTestJSON-1568769554 None] Lock "cinder-82191474-f64a-425a-97c4-3dd0f66b5537-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Deleted volume successfully. Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3921ee10-1eff-4f5d-8e0a-c3b31f9b2028 tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-7c30bc75-c67b-495d-ba89-b2866881bb0f-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:24 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 Jul 07 18:01:24 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:24 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.047s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:01:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:01:25 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc" returned: 0 in 0.879s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:25 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc Jul 07 18:01:25 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:25 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2" returned: 0 in 0.804s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[063de8cb-af02-4d0e-8460-19447130b610]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:25 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 Jul 07 18:01:25 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:25 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-286d0c4f-831b-433f-9242-7588ee493cdc" returned: 0 in 0.702s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-quobyte-286d0c4f-831b-433f-9242-7588ee493cdc" released by "delete_volume" :: held 1.653s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Created reservations ['97ab24ad-73e8-42aa-9c66-2b92c85cd306', 'fe4cacff-1938-4d82-8a71-e35053a68c01', '7444facb-17bc-4f1b-8d78-61b0c940ef5f', 'f83be3c6-2aea-45d2-a549-b34d4b704315'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Creating offline snapshot 60334233-3375-468d-b298-4860839929bf of volume 6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:25 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:25 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[69861749-6bf0-456a-8c16-feb2f2b44c05]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:26 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e Jul 07 18:01:26 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:26 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1" returned: 0 in 0.851s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:26 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 Jul 07 18:01:26 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "cinder-9b0af041-e643-46f1-b80d-c6fc1ae5da76-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-9b0af041-e643-46f1-b80d-c6fc1ae5da76-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "cinder-quobyte-9b0af041-e643-46f1-b80d-c6fc1ae5da76" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-quobyte-9b0af041-e643-46f1-b80d-c6fc1ae5da76" acquired by "delete_volume" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf6d3e5-277b-4468-9d57-73da6d2dd416]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:26 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 Jul 07 18:01:26 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:26 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.722s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:26 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Deleted volume successfully. Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c5f97467-d094-4cf6-8150-51104370a66a tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-286d0c4f-831b-433f-9242-7588ee493cdc-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:26 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e" returned: 0 in 0.859s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:26 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf 1G Jul 07 18:01:26 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:27 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2" returned: 0 in 0.922s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:27 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2 Jul 07 18:01:27 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:27 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76" returned: 0 in 0.765s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:27 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76 Jul 07 18:01:27 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:27 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf 1G" returned: 0 in 0.823s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b6b4717-491a-4e18-b47c-d074d5753e7e -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:27 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b6b4717-491a-4e18-b47c-d074d5753e7e -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf Jul 07 18:01:27 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:27 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9b0af041-e643-46f1-b80d-c6fc1ae5da76" returned: 0 in 0.655s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-quobyte-9b0af041-e643-46f1-b80d-c6fc1ae5da76" released by "delete_volume" :: held 1.468s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:27 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.3c729dca-5644-457e-a5d4-0b321b4821c2" returned: 0 in 0.714s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-3c729dca-5644-457e-a5d4-0b321b4821c2" released by "_delete_snapshot" :: held 3.415s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" released by "delete_snapshot" :: held 3.475s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Created reservations ['e7950784-5511-4a14-b35d-c7ae2b09df08', '9c4946b3-383b-4bc2-be3e-cd3bff842bd3', '91cb8837-947e-4ef8-9508-681c5269e5f2', '2d1d2c3e-5b02-45a4-b0e7-fc59b3d3916b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Created reservations ['404c6871-471d-4205-a0f4-2cb16b152640', '8a3c73e8-9177-43d5-b4bc-1b25fa7ae3a5', '677d102d-dbc3-493a-8f6e-4e53602aac7f', '442e75de-947f-42d4-bf33-51b76332ea27'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:28 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:28 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Delete snapshot completed successfully. Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c628f67c-7692-4ce5-93a8-9f7d7cc711a6 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-3c729dca-5644-457e-a5d4-0b321b4821c2-delete_snapshot" released by "delete_snapshot" :: held 3.696s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:28 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b6b4717-491a-4e18-b47c-d074d5753e7e -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf" returned: 0 in 0.682s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:28 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf is being set with open permissions: ugo+rw Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:28 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf Jul 07 18:01:28 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-b0cae644-07b4-4408-89f9-c4163dc62ec1-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-b0cae644-07b4-4408-89f9-c4163dc62ec1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-quobyte-b0cae644-07b4-4408-89f9-c4163dc62ec1" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b0cae644-07b4-4408-89f9-c4163dc62ec1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Deleting offline snapshot b0cae644-07b4-4408-89f9-c4163dc62ec1 of volume b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:28 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] snapshot_file for this snap is: volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.787s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Deleted volume successfully. Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[545c0ca7-1d57-4a06-b983-2877bdeb324c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bc13b42c-f279-4c93-82b1-190e67cc1bdc tempest-VolumesListAdminTestJSON-565860381 None] Lock "cinder-9b0af041-e643-46f1-b80d-c6fc1ae5da76-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:29 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf" returned: 0 in 0.677s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:29 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.info Jul 07 18:01:29 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:29 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 Jul 07 18:01:29 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:29 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1" returned: 0 in 0.836s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:29 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.info" returned: 0 in 0.769s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:29 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.info is being set with open permissions: ugo+rw Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1239d6eb-0dd8-437c-b231-bc206d587f0f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:29 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.info Jul 07 18:01:29 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:30 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa Jul 07 18:01:30 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:30 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.info" returned: 0 in 0.777s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.723s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cab2772d-c25d-4db7-8637-c6c232aeeaed tempest-VolumeDependencyTests-1399176668 None] Create snapshot completed successfully Jul 07 18:01:30 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" returned: 0 in 0.868s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:30 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 Jul 07 18:01:30 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:31 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1" returned: 0 in 0.810s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:31 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1 Jul 07 18:01:31 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Flow 'volume_create_manager' (3c5e5750-b18e-4fda-a5cc-d80db8ba97aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76386e78-9407-47e8-a4fc-167839641426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76386e78-9407-47e8-a4fc-167839641426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-501213450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a64e9b-57a7-4823-bc21-d2033c5b7901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564fcf60ec7b484eb8f250ac85df713b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60334233-3375-468d-b298-4860839929bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:32Z,use_quota=True,user_id='0bf7f9cf496e44e396af1348953b087e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d812b42a-c5e5-4fe2-a7a6-b7bd181bb865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d812b42a-c5e5-4fe2-a7a6-b7bd181bb865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7cdd23-c2f8-46df-bf2e-b52205cd30e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f7cdd23-c2f8-46df-bf2e-b52205cd30e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54a64e9b-57a7-4823-bc21-d2033c5b7901', 'volume_name': 'volume-54a64e9b-57a7-4823-bc21-d2033c5b7901', 'volume_size': 1, 'snapshot_id': '60334233-3375-468d-b298-4860839929bf'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8871d90a-40ec-4f39-a763-509b370a7d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8871d90a-40ec-4f39-a763-509b370a7d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4736ca2-103a-4808-9f3c-4e27343ec15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:31 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Volume 54a64e9b-57a7-4823-bc21-d2033c5b7901: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54a64e9b-57a7-4823-bc21-d2033c5b7901', 'volume_size': 1, 'snapshot_id': '60334233-3375-468d-b298-4860839929bf'} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-quobyte-60334233-3375-468d-b298-4860839929bf-54a64e9b-57a7-4823-bc21-d2033c5b7901" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-60334233-3375-468d-b298-4860839929bf-54a64e9b-57a7-4823-bc21-d2033c5b7901" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Creating volume 54a64e9b-57a7-4823-bc21-d2033c5b7901 from snapshot 60334233-3375-468d-b298-4860839929bf {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-quobyte-54a64e9b-57a7-4823-bc21-d2033c5b7901" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-54a64e9b-57a7-4823-bc21-d2033c5b7901" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] snapshot: 60334233-3375-468d-b298-4860839929bf, volume: 54a64e9b-57a7-4823-bc21-d2033c5b7901, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a57ca52-b802-45d9-8c71-0eed5b3b500c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:32 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf Jul 07 18:01:32 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:32 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa.b0cae644-07b4-4408-89f9-c4163dc62ec1" returned: 0 in 0.670s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b0cae644-07b4-4408-89f9-c4163dc62ec1" released by "_delete_snapshot" :: held 3.338s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" released by "delete_snapshot" :: held 3.362s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Created reservations ['7a784866-6fcd-474d-a63b-0becc6c3ff80', '269c7111-d490-4a02-80bb-d6cce75b7f6e', '721666b0-29b1-4e95-87ec-341d51fb3c3e', 'cf2c9d56-be48-4235-8018-e7571e195631'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:32 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Delete snapshot completed successfully. Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f082aaeb-0a4c-4249-bebb-2f8e7c640ce7 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-b0cae644-07b4-4408-89f9-c4163dc62ec1-delete_snapshot" released by "delete_snapshot" :: held 3.549s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:32 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf" returned: 0 in 0.842s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b6b4717-491a-4e18-b47c-d074d5753e7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b86b4f-2870-4828-a825-6fdd0b1bb8a9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:33 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e Jul 07 18:01:33 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-b2d67f3a-5bad-4fa9-8683-2a80760b16aa-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-b2d67f3a-5bad-4fa9-8683-2a80760b16aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=95,cinder:UPDATE=117,cinder:INSERT=25,cinder:DELETE=14 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=86,cinder:UPDATE=113,cinder:DELETE=6,cinder:INSERT=32 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[206cfb40-34c2-4f7d-92d6-4cfd72b80871]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Flow 'volume_create_manager' (f2b278fe-7080-46c8-8bda-d41338028638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfbaec5-9466-4e64-a804-6bee54f9d4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfbaec5-9466-4e64-a804-6bee54f9d4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1203564690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e275ae3f-2c26-4560-961d-ecfa28a491d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d851937a974d448812628edb34bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:33Z,use_quota=True,user_id='6b8593365ea84940ad5df727c2a82fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4185f036-6817-48d7-a37a-1ea05a4ed962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4185f036-6817-48d7-a37a-1ea05a4ed962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c52ffa8-e06d-49bd-aa92-c56eac31d832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c52ffa8-e06d-49bd-aa92-c56eac31d832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e275ae3f-2c26-4560-961d-ecfa28a491d1', 'volume_name': 'volume-e275ae3f-2c26-4560-961d-ecfa28a491d1', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d6aa80-08ff-4cb0-a35d-142b7de35254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d6aa80-08ff-4cb0-a35d-142b7de35254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:33 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa Jul 07 18:01:33 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cca4a1-a720-4321-b142-7314ebe6ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:33 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Volume e275ae3f-2c26-4560-961d-ecfa28a491d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e275ae3f-2c26-4560-961d-ecfa28a491d1', 'volume_size': 1} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:33 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e" returned: 0 in 0.837s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:01:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:33 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 Jul 07 18:01:33 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:34 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" returned: 0 in 0.778s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:34 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa Jul 07 18:01:34 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:35 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" returned: 0 in 1.096s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-quobyte-b2d67f3a-5bad-4fa9-8683-2a80760b16aa" released by "delete_volume" :: held 1.973s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Created reservations ['c9623505-51b4-4fcb-afcb-58d2755489e8', '69d07ce6-8afc-436a-9102-af6276da5049', 'acd58f15-2caa-4f84-8b1a-2f6fdecd2378', '7132d5a5-b6f7-409b-b414-6c53e4328a40'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:35 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:35 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:37 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.703s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:37 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Deleted volume successfully. Jul 07 18:01:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5835756a-144f-4676-bfbd-773fab336ed9 tempest-VolumesSnapshotListTestJSON-319818728 None] Lock "cinder-b2d67f3a-5bad-4fa9-8683-2a80760b16aa-delete_volume" released by "delete_volume" :: held 4.128s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:39 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901" returned: 0 in 5.414s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:39 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef54701-82bb-4547-af10-f0795d062a4f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:39 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e Jul 07 18:01:39 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:40 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e" returned: 0 in 1.017s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:01:40 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Converted 1024.00 MB image at 189.10 MB/s Jul 07 18:01:40 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 is being set with open permissions: ugo+rw Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:40 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 Jul 07 18:01:40 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:40 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901" returned: 0 in 0.656s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-54a64e9b-57a7-4823-bc21-d2033c5b7901" released by "_copy_volume_from_snapshot" :: held 8.889s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-60334233-3375-468d-b298-4860839929bf-54a64e9b-57a7-4823-bc21-d2033c5b7901" released by "_create_volume_from_snapshot" :: held 8.925s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.951s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.409s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1203564690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e275ae3f-2c26-4560-961d-ecfa28a491d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d851937a974d448812628edb34bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:33Z,use_quota=True,user_id='6b8593365ea84940ad5df727c2a82fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Creating volume e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:40 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:40 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 1073741824 Jul 07 18:01:40 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4736ca2-103a-4808-9f3c-4e27343ec15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a64e9b-57a7-4823-bc21-d2033c5b7901', 'volume_size': 1, 'snapshot_id': '60334233-3375-468d-b298-4860839929bf'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9296bd-e1f3-42d6-97a1-7befd94f07b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:40 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Volume volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 (54a64e9b-57a7-4823-bc21-d2033c5b7901): created successfully Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9296bd-e1f3-42d6-97a1-7befd94f07b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:40 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Flow 'volume_create_manager' (3c5e5750-b18e-4fda-a5cc-d80db8ba97aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ab204773-ef9f-43cd-be77-d72ecd311ac2 tempest-VolumeDependencyTests-1399176668 None] Created volume successfully. Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Flow 'volume_create_manager' (68c0d85c-50cd-4dc6-a177-f5f8fbfc3884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27159390-2220-4c6c-895e-a06a16d2acdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27159390-2220-4c6c-895e-a06a16d2acdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-244259551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48275abb-54fb-4dd3-b889-d913f5089bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14c17de506a4014a3d20147d1fad8b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:41Z,use_quota=True,user_id='374a2716e46c4f6592e21e71e28dd73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5e8414-9f10-4287-a35c-0befbfc4c066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5e8414-9f10-4287-a35c-0befbfc4c066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a592a08-5965-4897-9034-51902e773684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a592a08-5965-4897-9034-51902e773684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48275abb-54fb-4dd3-b889-d913f5089bd6', 'volume_name': 'volume-48275abb-54fb-4dd3-b889-d913f5089bd6', 'volume_size': 2}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fc5db9-8cb3-4eb6-b6a5-89e1281e5006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fc5db9-8cb3-4eb6-b6a5-89e1281e5006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccc9d20-92fa-4f65-bd9e-10d255236781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:41 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Volume 48275abb-54fb-4dd3-b889-d913f5089bd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48275abb-54fb-4dd3-b889-d913f5089bd6', 'volume_size': 2} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-60334233-3375-468d-b298-4860839929bf-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-60334233-3375-468d-b298-4860839929bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-quobyte-6b6b4717-491a-4e18-b47c-d074d5753e7e" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:41 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-6b6b4717-491a-4e18-b47c-d074d5753e7e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-quobyte-60334233-3375-468d-b298-4860839929bf" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 1073741824" returned: 0 in 0.888s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-60334233-3375-468d-b298-4860839929bf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Deleting offline snapshot 60334233-3375-468d-b298-4860839929bf of volume 6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] snapshot_file for this snap is: volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce2f9e2-d527-491a-b4f3-269847208bc8]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:41 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 Jul 07 18:01:41 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:41 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf Jul 07 18:01:41 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:42 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1" returned: 0 in 0.715s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-244259551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48275abb-54fb-4dd3-b889-d913f5089bd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e14c17de506a4014a3d20147d1fad8b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:41Z,use_quota=True,user_id='374a2716e46c4f6592e21e71e28dd73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Creating volume 48275abb-54fb-4dd3-b889-d913f5089bd6 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:42 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 2147483648 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19cca4a1-a720-4321-b142-7314ebe6ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e275ae3f-2c26-4560-961d-ecfa28a491d1', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:42 devstack sudo[100115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 2147483648 Jul 07 18:01:42 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5511d343-c58d-4c22-84a8-bc3dbc11bd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:42 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Volume volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 (e275ae3f-2c26-4560-961d-ecfa28a491d1): created successfully Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5511d343-c58d-4c22-84a8-bc3dbc11bd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Flow 'volume_create_manager' (f2b278fe-7080-46c8-8bda-d41338028638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7137fbbe-5945-405f-88f9-c566b6011028 tempest-VolumesDeleteCascade-507612943 None] Created volume successfully. Jul 07 18:01:42 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf" returned: 0 in 0.843s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b6b4717-491a-4e18-b47c-d074d5753e7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e04454f-2daf-461d-867e-07195b113e6e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:42 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e Jul 07 18:01:42 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:43 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e" returned: 0 in 0.834s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:43 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 2147483648" returned: 0 in 0.997s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:43 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf Jul 07 18:01:43 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:43 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 Jul 07 18:01:43 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:44 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6" returned: 0 in 0.646s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.771s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:44 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf" returned: 0 in 0.706s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:44 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf Jul 07 18:01:44 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccc9d20-92fa-4f65-bd9e-10d255236781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48275abb-54fb-4dd3-b889-d913f5089bd6', 'volume_size': 2}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f133d8b7-40a6-4abd-9b3f-fa2623d573d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Creating offline snapshot 9b04dd9b-4670-44aa-80fd-935b0c870658 of volume e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:44 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Volume volume-48275abb-54fb-4dd3-b889-d913f5089bd6 (48275abb-54fb-4dd3-b889-d913f5089bd6): created successfully Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f133d8b7-40a6-4abd-9b3f-fa2623d573d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Flow 'volume_create_manager' (68c0d85c-50cd-4dc6-a177-f5f8fbfc3884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35bf2e6-45d6-4fea-9004-84388fd17ff2]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-73a4b819-d9b5-4c4f-95d3-4d3cba548e62 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Created volume successfully. Jul 07 18:01:44 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 Jul 07 18:01:44 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:44 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e.60334233-3375-468d-b298-4860839929bf" returned: 0 in 0.640s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-60334233-3375-468d-b298-4860839929bf" released by "_delete_snapshot" :: held 3.136s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-6b6b4717-491a-4e18-b47c-d074d5753e7e" released by "delete_snapshot" :: held 3.173s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:45 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Created reservations ['e442782b-eabf-4575-a7f8-edac4ebf5708', 'f40fb48a-c57d-4e1b-a54f-4e699d90c692', '2c07cec1-1ca7-4b8e-8d1c-c94eeb706035', '13001aa7-aace-4431-ae4d-a7b3b524a101'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Delete snapshot completed successfully. Jul 07 18:01:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0893751-fcaf-4945-9ffb-f4d30b9595e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-60334233-3375-468d-b298-4860839929bf-delete_snapshot" released by "delete_snapshot" :: held 3.325s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:45 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1" returned: 0 in 0.752s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:45 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 1G Jul 07 18:01:45 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:45 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 1G" returned: 0 in 0.778s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:45 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 Jul 07 18:01:45 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-6b6b4717-491a-4e18-b47c-d074d5753e7e-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-6b6b4717-491a-4e18-b47c-d074d5753e7e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-quobyte-6b6b4717-491a-4e18-b47c-d074d5753e7e" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-6b6b4717-491a-4e18-b47c-d074d5753e7e" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b77e399-6a3d-4186-9851-b9581bf4bd40]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:46 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e Jul 07 18:01:46 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:46 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658" returned: 0 in 0.687s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:46 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 is being set with open permissions: ugo+rw Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:46 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 Jul 07 18:01:46 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:46 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e" returned: 0 in 0.803s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:46 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e Jul 07 18:01:46 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:47 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658" returned: 0 in 0.659s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:47 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.info Jul 07 18:01:47 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:47 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6b6b4717-491a-4e18-b47c-d074d5753e7e" returned: 0 in 0.650s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-6b6b4717-491a-4e18-b47c-d074d5753e7e" released by "delete_volume" :: held 1.539s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Created reservations ['a9a68c99-6f7a-4b0c-8c98-5ebacbe3cc36', '6cd3cf03-0e0c-4f09-9acb-c75a7a8a7ebd', '44957e5a-7a3f-409b-8878-a204ab0303b5', 'd4efefa1-9a93-4b7e-bb11-f24a337ad595'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:47 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:47 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:47 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.info" returned: 0 in 0.665s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:47 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.info is being set with open permissions: ugo+rw Jul 07 18:01:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:47 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.info Jul 07 18:01:47 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-54a64e9b-57a7-4823-bc21-d2033c5b7901-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-54a64e9b-57a7-4823-bc21-d2033c5b7901-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "cinder-quobyte-54a64e9b-57a7-4823-bc21-d2033c5b7901" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-54a64e9b-57a7-4823-bc21-d2033c5b7901" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a0f687-83cf-45a3-8eb0-c253d95f835a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:48 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.680s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Deleted volume successfully. Jul 07 18:01:48 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 Jul 07 18:01:48 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bfc28f7a-c267-46c4-8bd0-0773b1f8e837 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-6b6b4717-491a-4e18-b47c-d074d5753e7e-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:48 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.info" returned: 0 in 0.682s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.391s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.973s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Creating offline snapshot 45863dd7-cd8e-4156-a407-a8a3c0b0c829 of volume 48275abb-54fb-4dd3-b889-d913f5089bd6 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-73f4f66d-a49c-4f24-b667-ec4803b6c94a tempest-VolumesDeleteCascade-507612943 None] Create snapshot completed successfully Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db4de9-01fb-4bc0-83a1-53a80627ed94]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:48 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 Jul 07 18:01:48 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:49 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901" returned: 0 in 0.787s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:49 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901 Jul 07 18:01:49 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:49 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6" returned: 0 in 0.766s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 2G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:49 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 2G Jul 07 18:01:49 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:49 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-54a64e9b-57a7-4823-bc21-d2033c5b7901" returned: 0 in 0.716s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-quobyte-54a64e9b-57a7-4823-bc21-d2033c5b7901" released by "delete_volume" :: held 1.560s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:49 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Created reservations ['9ec67158-bb2b-4121-80a8-22a37e497968', 'b7d0ad14-6bae-4517-8fbf-f1abcc77fbb5', 'a60320fd-73c0-43cb-9373-c8f5b42ebdc0', '7d6cec9c-6e93-46b8-ac42-61f796093527'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:50 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:01:50 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:50 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 2G" returned: 0 in 0.840s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48275abb-54fb-4dd3-b889-d913f5089bd6 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:50 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48275abb-54fb-4dd3-b889-d913f5089bd6 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 Jul 07 18:01:50 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:50 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.741s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Deleted volume successfully. Jul 07 18:01:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f064a662-bfa3-4553-8b97-ef8b6a95f3e5 tempest-VolumeDependencyTests-1399176668 None] Lock "cinder-54a64e9b-57a7-4823-bc21-d2033c5b7901-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:51 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48275abb-54fb-4dd3-b889-d913f5089bd6 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829" returned: 0 in 0.727s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:51 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 is being set with open permissions: ugo+rw Jul 07 18:01:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:51 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 Jul 07 18:01:51 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:51 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829" returned: 0 in 0.680s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:51 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.info Jul 07 18:01:51 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:52 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.info" returned: 0 in 0.671s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:52 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.info is being set with open permissions: ugo+rw Jul 07 18:01:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:52 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.info Jul 07 18:01:52 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:53 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.info" returned: 0 in 0.668s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.464s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.160s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Creating offline snapshot 31c62c39-0075-498f-94a6-54e3981ffea6 of volume e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-999f5ec6-197b-4a93-b74c-70302bf0f69f tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Create snapshot completed successfully Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8148a0c9-5cbf-4498-87e6-cea8986076b2]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:53 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 Jul 07 18:01:53 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:53 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658" returned: 0 in 0.775s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e275ae3f-2c26-4560-961d-ecfa28a491d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:54 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 1G Jul 07 18:01:54 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "cinder-45863dd7-cd8e-4156-a407-a8a3c0b0c829-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-45863dd7-cd8e-4156-a407-a8a3c0b0c829-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "cinder-quobyte-48275abb-54fb-4dd3-b889-d913f5089bd6" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-quobyte-48275abb-54fb-4dd3-b889-d913f5089bd6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "cinder-quobyte-45863dd7-cd8e-4156-a407-a8a3c0b0c829" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-quobyte-45863dd7-cd8e-4156-a407-a8a3c0b0c829" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Deleting offline snapshot 45863dd7-cd8e-4156-a407-a8a3c0b0c829 of volume 48275abb-54fb-4dd3-b889-d913f5089bd6 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] snapshot_file for this snap is: volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c5ae61-dfc0-419c-ba33-836ac6d4dfd4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:54 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 Jul 07 18:01:54 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:54 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 1G" returned: 0 in 1.006s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:55 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 Jul 07 18:01:55 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:55 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829" returned: 0 in 0.855s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48275abb-54fb-4dd3-b889-d913f5089bd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:55 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b3ddce-ec9c-474a-b266-464e2a04b472]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:55 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 Jul 07 18:01:55 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:55 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6" returned: 0 in 0.773s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:55 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 is being set with open permissions: ugo+rw Jul 07 18:01:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:55 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 Jul 07 18:01:55 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:55 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6" returned: 0 in 0.786s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:55 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 Jul 07 18:01:55 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:56 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6" returned: 0 in 0.731s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.405s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b25bd879-c7e6-4b40-9ecf-04cbd6a00ba1 tempest-VolumesDeleteCascade-507612943 None] Create snapshot completed successfully Jul 07 18:01:56 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829" returned: 0 in 0.872s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:56 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829 Jul 07 18:01:56 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-e275ae3f-2c26-4560-961d-ecfa28a491d1-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-e275ae3f-2c26-4560-961d-ecfa28a491d1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Performing cascade delete. {{(pid=87228) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-31c62c39-0075-498f-94a6-54e3981ffea6-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-31c62c39-0075-498f-94a6-54e3981ffea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-31c62c39-0075-498f-94a6-54e3981ffea6" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:57 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6.45863dd7-cd8e-4156-a407-a8a3c0b0c829" returned: 0 in 0.703s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-31c62c39-0075-498f-94a6-54e3981ffea6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Deleting offline snapshot 31c62c39-0075-498f-94a6-54e3981ffea6 of volume e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] snapshot_file for this snap is: volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1023c172-07db-4654-aeda-5cf502c87dc9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-quobyte-45863dd7-cd8e-4156-a407-a8a3c0b0c829" released by "_delete_snapshot" :: held 3.391s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-quobyte-48275abb-54fb-4dd3-b889-d913f5089bd6" released by "delete_snapshot" :: held 3.420s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Created reservations ['951c519e-cf34-4ef4-8915-ca627c330055', '291f0115-0bad-4077-9f10-c3f6671753fe', '625e64ad-62a5-4a92-afb4-3f1240ea4146', 'f8130247-9145-40f9-b9a3-7906856f5a97'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:57 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 Jul 07 18:01:57 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Delete snapshot completed successfully. Jul 07 18:01:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-351b4ef4-0751-4c00-b14e-bcfce7b33824 tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-45863dd7-cd8e-4156-a407-a8a3c0b0c829-delete_snapshot" released by "delete_snapshot" :: held 3.593s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:58 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6" returned: 0 in 0.775s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e275ae3f-2c26-4560-961d-ecfa28a491d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2722ec1e-e726-41bb-a027-ed654eec5e5b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "cinder-48275abb-54fb-4dd3-b889-d913f5089bd6-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-48275abb-54fb-4dd3-b889-d913f5089bd6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:58 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 Jul 07 18:01:58 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "cinder-quobyte-48275abb-54fb-4dd3-b889-d913f5089bd6" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-quobyte-48275abb-54fb-4dd3-b889-d913f5089bd6" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca107d8-6262-456b-b561-71c2b5b80489]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:58 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 Jul 07 18:01:58 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:59 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658" returned: 0 in 0.844s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e275ae3f-2c26-4560-961d-ecfa28a491d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:59 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 Jul 07 18:01:59 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:59 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6" returned: 0 in 0.796s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:59 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6 Jul 07 18:01:59 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:00 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-48275abb-54fb-4dd3-b889-d913f5089bd6" returned: 0 in 0.674s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:00 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6" returned: 0 in 0.877s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-quobyte-48275abb-54fb-4dd3-b889-d913f5089bd6" released by "delete_volume" :: held 1.550s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:00 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6 Jul 07 18:02:00 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Created reservations ['a225a3c8-2b4a-4f95-b1f7-a6c4f920a7df', '15c1c55a-7fdd-407e-b992-81cfe6834528', '92fd427d-a603-42e5-b0b3-546858cffe42', '3369d0b8-6086-4d96-9f8a-6c6d94bea540'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:00 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:02:00 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:00 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.31c62c39-0075-498f-94a6-54e3981ffea6" returned: 0 in 0.726s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-31c62c39-0075-498f-94a6-54e3981ffea6" released by "_delete_snapshot" :: held 3.355s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" released by "delete_snapshot" :: held 3.384s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:00 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Created reservations ['b8869d75-7b86-45f2-a58e-c73dcff1ef5d', 'e8c638af-323d-40ee-82dd-16713e4fd5f0', 'f4ee4426-6e0b-4b91-8584-1ab65bc6980d', 'ca08aead-03a6-4843-ac70-d6615d0e8efc'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:01 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Delete snapshot completed successfully. Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-31c62c39-0075-498f-94a6-54e3981ffea6-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-9b04dd9b-4670-44aa-80fd-935b0c870658-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-9b04dd9b-4670-44aa-80fd-935b0c870658-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-9b04dd9b-4670-44aa-80fd-935b0c870658" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-9b04dd9b-4670-44aa-80fd-935b0c870658" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Deleting offline snapshot 9b04dd9b-4670-44aa-80fd-935b0c870658 of volume e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:02:01 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] snapshot_file for this snap is: volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.812s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:01 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Deleted volume successfully. Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a25e756-6812-4e8e-8228-1059f612a30c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e70d824b-c4a3-47ee-9f2d-ece42f17c91d tempest-VolumesSnapshotNegativeTestJSON-1864850085 None] Lock "cinder-48275abb-54fb-4dd3-b889-d913f5089bd6-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:01 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 Jul 07 18:02:01 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:02 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658" returned: 0 in 0.903s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e275ae3f-2c26-4560-961d-ecfa28a491d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:02:02 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd06babd-7aa2-4c23-89a7-3fc9966f3af5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:02 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 Jul 07 18:02:02 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:02 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1" returned: 0 in 0.798s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:02 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 Jul 07 18:02:02 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:03 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658" returned: 0 in 0.735s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:03 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658 Jul 07 18:02:03 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:04 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1.9b04dd9b-4670-44aa-80fd-935b0c870658" returned: 0 in 0.718s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-9b04dd9b-4670-44aa-80fd-935b0c870658" released by "_delete_snapshot" :: held 3.285s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" released by "delete_snapshot" :: held 3.323s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Created reservations ['09ef510f-d501-4b24-ae4d-37436d7f32eb', 'f6d46283-e8bf-4eda-a6eb-89b4f3ba85a5', '58113377-e7d4-4d92-9867-28280ebe10ce', '78d94550-64f4-46d6-8264-cab572ca97b4'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Delete snapshot completed successfully. Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-9b04dd9b-4670-44aa-80fd-935b0c870658-delete_snapshot" released by "delete_snapshot" :: held 3.503s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Snapshots deleted, issuing volume delete {{(pid=87228) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" acquired by "delete_volume" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc639508-2b55-494a-b477-80485169c9e8]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:04 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 Jul 07 18:02:04 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:05 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1" returned: 0 in 0.777s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:05 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1 Jul 07 18:02:05 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:06 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e275ae3f-2c26-4560-961d-ecfa28a491d1" returned: 0 in 0.645s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-e275ae3f-2c26-4560-961d-ecfa28a491d1" released by "delete_volume" :: held 1.487s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Created reservations ['794c4725-5c38-4018-9765-1136d90645c0', '6b27a592-a418-4608-85b4-7638a084cc13', '7cf0eac2-22ca-4cd4-af3b-b4ef5c15b402', '66852998-283c-4879-893a-20a26f7de238'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:06 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:02:06 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:06 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.695s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:06 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Deleted volume successfully. Jul 07 18:02:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ff942d39-e9a1-4904-9f41-2ee8a589d8ad tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-e275ae3f-2c26-4560-961d-ecfa28a491d1-delete_volume" released by "delete_volume" :: held 9.559s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Flow 'volume_create_manager' (56a17dc5-6cac-4607-8a70-d5c3ea0cf6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a92e8c-e1e5-46f9-b461-dd90bb0da004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a92e8c-e1e5-46f9-b461-dd90bb0da004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997941287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced9b83c-ae76-4d73-b62f-dbec7274292a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d851937a974d448812628edb34bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:08Z,use_quota=True,user_id='6b8593365ea84940ad5df727c2a82fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa19042-db61-40da-adf4-37eccd6f637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa19042-db61-40da-adf4-37eccd6f637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4484edc2-d86e-45f6-81a0-e16524990ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4484edc2-d86e-45f6-81a0-e16524990ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced9b83c-ae76-4d73-b62f-dbec7274292a', 'volume_name': 'volume-ced9b83c-ae76-4d73-b62f-dbec7274292a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9150bee2-fb57-4b71-b011-9465ff4ee8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9150bee2-fb57-4b71-b011-9465ff4ee8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ad78c1-157c-4c88-a873-43c3bb3f989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:07 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Volume ced9b83c-ae76-4d73-b62f-dbec7274292a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced9b83c-ae76-4d73-b62f-dbec7274292a', 'volume_size': 1} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-997941287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced9b83c-ae76-4d73-b62f-dbec7274292a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d851937a974d448812628edb34bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:08Z,use_quota=True,user_id='6b8593365ea84940ad5df727c2a82fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Creating volume ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:02:07 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:02:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:07 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a 1073741824 Jul 07 18:02:07 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:08 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a 1073741824" returned: 0 in 0.871s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:08 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a Jul 07 18:02:08 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:09 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a" returned: 0 in 0.655s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:02:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ad78c1-157c-4c88-a873-43c3bb3f989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced9b83c-ae76-4d73-b62f-dbec7274292a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f64006-f6b6-4528-8ff3-c52eec7cb54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:09 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Volume volume-ced9b83c-ae76-4d73-b62f-dbec7274292a (ced9b83c-ae76-4d73-b62f-dbec7274292a): created successfully Jul 07 18:02:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f64006-f6b6-4528-8ff3-c52eec7cb54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Flow 'volume_create_manager' (56a17dc5-6cac-4607-8a70-d5c3ea0cf6d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:09 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-582f67d9-9476-49ce-bc9f-60a130d5734f tempest-VolumesDeleteCascade-507612943 None] Created volume successfully. Jul 07 18:02:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Creating offline snapshot 5c4b6532-0d78-47ea-a19b-18f1ed091fba of volume ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:02:10 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[12deb6b4-004d-474c-ac74-b44270a4a61b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:10 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a Jul 07 18:02:10 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:10 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a" returned: 0 in 0.768s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:10 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba 1G Jul 07 18:02:10 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:11 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba 1G" returned: 0 in 0.845s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced9b83c-ae76-4d73-b62f-dbec7274292a -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:11 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced9b83c-ae76-4d73-b62f-dbec7274292a -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba Jul 07 18:02:11 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:12 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ced9b83c-ae76-4d73-b62f-dbec7274292a -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba" returned: 0 in 0.690s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:12 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba is being set with open permissions: ugo+rw Jul 07 18:02:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:12 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba Jul 07 18:02:12 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:13 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba" returned: 0 in 0.678s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:13 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.info Jul 07 18:02:13 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:13 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.info" returned: 0 in 0.670s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:13 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.info is being set with open permissions: ugo+rw Jul 07 18:02:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:13 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.info Jul 07 18:02:13 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:14 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.info" returned: 0 in 0.644s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.401s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-906eb44e-5847-4982-902f-8e407c2a8fe5 tempest-VolumesDeleteCascade-507612943 None] Create snapshot completed successfully Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Flow 'volume_create_manager' (3c1356c5-0bdc-4b23-9fb4-16bb80c08959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a760c7-364d-4576-9d15-f12f21431692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62a760c7-364d-4576-9d15-f12f21431692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-854563082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2316b2dd-26b6-4d03-8181-8d319c90339a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d851937a974d448812628edb34bab4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c4b6532-0d78-47ea-a19b-18f1ed091fba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:16Z,use_quota=True,user_id='6b8593365ea84940ad5df727c2a82fc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94cc0a7-29fb-486b-95a1-906bb62d97a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d94cc0a7-29fb-486b-95a1-906bb62d97a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aaa47be-fe26-48e8-b3b8-88df3f5f7b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aaa47be-fe26-48e8-b3b8-88df3f5f7b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2316b2dd-26b6-4d03-8181-8d319c90339a', 'volume_name': 'volume-2316b2dd-26b6-4d03-8181-8d319c90339a', 'volume_size': 1, 'snapshot_id': '5c4b6532-0d78-47ea-a19b-18f1ed091fba'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69ccc7f-6298-4557-af68-7ca4572fa331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69ccc7f-6298-4557-af68-7ca4572fa331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a087c70-bb3e-45e5-b0b6-84f02106e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Volume 2316b2dd-26b6-4d03-8181-8d319c90339a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2316b2dd-26b6-4d03-8181-8d319c90339a', 'volume_size': 1, 'snapshot_id': '5c4b6532-0d78-47ea-a19b-18f1ed091fba'} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-5c4b6532-0d78-47ea-a19b-18f1ed091fba-2316b2dd-26b6-4d03-8181-8d319c90339a" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-5c4b6532-0d78-47ea-a19b-18f1ed091fba-2316b2dd-26b6-4d03-8181-8d319c90339a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Creating volume 2316b2dd-26b6-4d03-8181-8d319c90339a from snapshot 5c4b6532-0d78-47ea-a19b-18f1ed091fba {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-2316b2dd-26b6-4d03-8181-8d319c90339a" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-2316b2dd-26b6-4d03-8181-8d319c90339a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] snapshot: 5c4b6532-0d78-47ea-a19b-18f1ed091fba, volume: 2316b2dd-26b6-4d03-8181-8d319c90339a, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e9067a-2659-4d0f-815c-4c101219f257]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:16 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba Jul 07 18:02:16 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:16 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba" returned: 0 in 0.776s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced9b83c-ae76-4d73-b62f-dbec7274292a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac75866-d5e9-4bbd-9b63-f946a6964dcf]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:16 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a Jul 07 18:02:16 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:17 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a" returned: 0 in 0.788s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:17 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:02:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:17 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a Jul 07 18:02:17 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:22 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a" returned: 0 in 5.023s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e700d49f-2f66-4bdf-b20f-92ed7e93ad85]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:22 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a Jul 07 18:02:22 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:23 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a" returned: 0 in 0.963s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:02:23 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Converted 1024.00 MB image at 203.79 MB/s Jul 07 18:02:23 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a is being set with open permissions: ugo+rw Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:23 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a Jul 07 18:02:23 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:23 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:02:23 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:24 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a" returned: 0 in 0.683s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-2316b2dd-26b6-4d03-8181-8d319c90339a" released by "_copy_volume_from_snapshot" :: held 8.335s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-5c4b6532-0d78-47ea-a19b-18f1ed091fba-2316b2dd-26b6-4d03-8181-8d319c90339a" released by "_create_volume_from_snapshot" :: held 8.369s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.386s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a087c70-bb3e-45e5-b0b6-84f02106e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2316b2dd-26b6-4d03-8181-8d319c90339a', 'volume_size': 1, 'snapshot_id': '5c4b6532-0d78-47ea-a19b-18f1ed091fba'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211d8163-d24b-4b1e-a4d6-631194befa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:24 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Volume volume-2316b2dd-26b6-4d03-8181-8d319c90339a (2316b2dd-26b6-4d03-8181-8d319c90339a): created successfully Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211d8163-d24b-4b1e-a4d6-631194befa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Flow 'volume_create_manager' (3c1356c5-0bdc-4b23-9fb4-16bb80c08959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-84153614-a89c-4ff8-afb3-8ca498ddddb2 tempest-VolumesDeleteCascade-507612943 None] Created volume successfully. Jul 07 18:02:24 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.702s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-ced9b83c-ae76-4d73-b62f-dbec7274292a-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-ced9b83c-ae76-4d73-b62f-dbec7274292a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Performing cascade delete. {{(pid=87228) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-5c4b6532-0d78-47ea-a19b-18f1ed091fba-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-5c4b6532-0d78-47ea-a19b-18f1ed091fba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-ced9b83c-ae76-4d73-b62f-dbec7274292a" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-ced9b83c-ae76-4d73-b62f-dbec7274292a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-5c4b6532-0d78-47ea-a19b-18f1ed091fba" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-5c4b6532-0d78-47ea-a19b-18f1ed091fba" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Deleting offline snapshot 5c4b6532-0d78-47ea-a19b-18f1ed091fba of volume ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] snapshot_file for this snap is: volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a5477a-5202-4b71-872a-51f6ac7f3f67]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:25 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba Jul 07 18:02:25 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:25 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba" returned: 0 in 0.817s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ced9b83c-ae76-4d73-b62f-dbec7274292a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:02:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6485de37-4bf3-4337-96e2-e97502f96126]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:25 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a Jul 07 18:02:25 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:26 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a" returned: 0 in 0.791s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:26 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba Jul 07 18:02:26 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:27 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba" returned: 0 in 0.752s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:27 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba Jul 07 18:02:27 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:27 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a.5c4b6532-0d78-47ea-a19b-18f1ed091fba" returned: 0 in 0.672s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-5c4b6532-0d78-47ea-a19b-18f1ed091fba" released by "_delete_snapshot" :: held 3.146s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-ced9b83c-ae76-4d73-b62f-dbec7274292a" released by "delete_snapshot" :: held 3.172s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Created reservations ['973513e5-b2af-49e1-8259-feb4f4c75c22', '29e56b81-19b0-4dc4-b471-77263a94bc1a', 'a382887d-5b4f-4f9e-b69b-64c0ff07013a', 'd6a78830-f6ec-44b9-a58f-82378732fadb'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Delete snapshot completed successfully. Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-5c4b6532-0d78-47ea-a19b-18f1ed091fba-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Snapshots deleted, issuing volume delete {{(pid=87228) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-ced9b83c-ae76-4d73-b62f-dbec7274292a" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-ced9b83c-ae76-4d73-b62f-dbec7274292a" acquired by "delete_volume" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cfd9e8-4400-4d22-aad1-49fedb652684]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:28 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a Jul 07 18:02:28 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:28 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a" returned: 0 in 0.743s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:28 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a Jul 07 18:02:28 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Flow 'volume_create_manager' (b7f4fd1e-6235-4bf2-85eb-06c2ade02438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0770ddfd-cab7-4706-b9f4-458e39781817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0770ddfd-cab7-4706-b9f4-458e39781817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-540405708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf24e620-6438-4fb3-823f-37097a917e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6989c7995e649e3b0c7b1031942f8c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:29Z,use_quota=True,user_id='d18cfa46418147eab3577a8ff7beb63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(897ef345-6146-4fce-aea9-f81cb2d373ce),volume_type_id=897ef345-6146-4fce-aea9-f81cb2d373ce)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8110e235-3760-4c02-a59f-20d2d9302e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8110e235-3760-4c02-a59f-20d2d9302e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfc9497-f123-43d1-96eb-29f5fae8cbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfc9497-f123-43d1-96eb-29f5fae8cbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf24e620-6438-4fb3-823f-37097a917e86', 'volume_name': 'volume-bf24e620-6438-4fb3-823f-37097a917e86', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2731403-ff70-46a8-bb0d-02e2718a4e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2731403-ff70-46a8-bb0d-02e2718a4e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a71abb-803a-4731-9216-80e2d8b87bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:29 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume bf24e620-6438-4fb3-823f-37097a917e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf24e620-6438-4fb3-823f-37097a917e86', 'volume_size': 1} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-540405708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf24e620-6438-4fb3-823f-37097a917e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6989c7995e649e3b0c7b1031942f8c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:29Z,use_quota=True,user_id='d18cfa46418147eab3577a8ff7beb63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(897ef345-6146-4fce-aea9-f81cb2d373ce),volume_type_id=897ef345-6146-4fce-aea9-f81cb2d373ce)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Creating volume bf24e620-6438-4fb3-823f-37097a917e86 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:02:29 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:29 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 1073741824 Jul 07 18:02:29 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:29 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ced9b83c-ae76-4d73-b62f-dbec7274292a" returned: 0 in 0.680s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-ced9b83c-ae76-4d73-b62f-dbec7274292a" released by "delete_volume" :: held 1.488s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Created reservations ['c5cb6a6d-a9bb-4fc4-88d6-72025a2dd1cf', '78497482-7f26-49d0-8c09-2f64f38287c0', '6d8e4c46-5ec6-4959-b35c-3452870a7aec', '11ea9771-facd-4dda-abb5-be5bace829d7'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:29 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:02:29 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:29 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Flow 'volume_create_manager' (d6d33c5c-10c0-4b0c-9573-20107e4e4788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73512d65-76e6-47f0-9428-8905f8ff3a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73512d65-76e6-47f0-9428-8905f8ff3a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363638256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ba5e44-8740-41be-b159-c7d16c9de733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6989c7995e649e3b0c7b1031942f8c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:30Z,use_quota=True,user_id='d18cfa46418147eab3577a8ff7beb63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(250547fb-b1e6-4a96-8517-71c9d2f593e5),volume_type_id=250547fb-b1e6-4a96-8517-71c9d2f593e5)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f6617e-832e-4950-a690-123726cc2246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f6617e-832e-4950-a690-123726cc2246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dd9461-c4b0-4afb-a4d4-3ba0790e2d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2dd9461-c4b0-4afb-a4d4-3ba0790e2d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ba5e44-8740-41be-b159-c7d16c9de733', 'volume_name': 'volume-b6ba5e44-8740-41be-b159-c7d16c9de733', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcc30ad-eafd-482c-8fc5-af8222f17339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcc30ad-eafd-482c-8fc5-af8222f17339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b85ab14-e39a-4805-93f7-2da6a6c66726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume b6ba5e44-8740-41be-b159-c7d16c9de733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ba5e44-8740-41be-b159-c7d16c9de733', 'volume_size': 1} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-2316b2dd-26b6-4d03-8181-8d319c90339a-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-2316b2dd-26b6-4d03-8181-8d319c90339a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "cinder-quobyte-2316b2dd-26b6-4d03-8181-8d319c90339a" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-2316b2dd-26b6-4d03-8181-8d319c90339a" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb3d4d-7cb6-45c5-8a1c-f2659541715e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Flow 'volume_create_manager' (9e5ce9d8-fa12-428a-a7a0-41417494a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:30 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a Jul 07 18:02:30 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c17f8f0-2514-43c6-b056-2a74c499f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c17f8f0-2514-43c6-b056-2a74c499f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-265198564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302d65ef-e334-43f2-88f6-418281ff224b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6989c7995e649e3b0c7b1031942f8c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:31Z,use_quota=True,user_id='d18cfa46418147eab3577a8ff7beb63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(033ee810-c73b-4c68-b0a7-540fafee99ef),volume_type_id=033ee810-c73b-4c68-b0a7-540fafee99ef)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe32584-181b-43e0-a8f5-2b93284fdbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe32584-181b-43e0-a8f5-2b93284fdbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36118817-b1ea-4f1e-83d4-22bd40e405da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:02:30 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 1073741824" returned: 0 in 1.097s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:30 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.896s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Deleted volume successfully. Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b662da9-ba7b-4499-8735-944afc19af6a tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-ced9b83c-ae76-4d73-b62f-dbec7274292a-delete_volume" released by "delete_volume" :: held 6.024s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:30 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 Jul 07 18:02:30 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36118817-b1ea-4f1e-83d4-22bd40e405da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '302d65ef-e334-43f2-88f6-418281ff224b', 'volume_name': 'volume-302d65ef-e334-43f2-88f6-418281ff224b', 'volume_size': 1, 'image_id': '198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--668669325', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6989c7995e649e3b0c7b1031942f8c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'created_at': datetime.datetime(2026, 7, 7, 16, 2, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9/file', 'properties': {}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51205c6c-457a-40b6-8138-17e1b2d6327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51205c6c-457a-40b6-8138-17e1b2d6327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c74229-c461-45c5-9112-d5f834c8a15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:31 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume 302d65ef-e334-43f2-88f6-418281ff224b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-302d65ef-e334-43f2-88f6-418281ff224b', 'volume_size': 1, 'image_id': '198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--668669325', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6989c7995e649e3b0c7b1031942f8c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'created_at': datetime.datetime(2026, 7, 7, 16, 2, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9/file', 'properties': {}}, 'image_service': } Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Trying to clone 302d65ef-e334-43f2-88f6-418281ff224b from image 198fbdb1-de6d-4420-9c92-10f9bea3abc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 18:02:31 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86" returned: 0 in 0.792s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363638256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ba5e44-8740-41be-b159-c7d16c9de733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6989c7995e649e3b0c7b1031942f8c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:30Z,use_quota=True,user_id='d18cfa46418147eab3577a8ff7beb63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(250547fb-b1e6-4a96-8517-71c9d2f593e5),volume_type_id=250547fb-b1e6-4a96-8517-71c9d2f593e5)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Creating volume b6ba5e44-8740-41be-b159-c7d16c9de733 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:02:31 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:31 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a" returned: 0 in 1.107s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:31 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 1073741824 Jul 07 18:02:31 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a71abb-803a-4731-9216-80e2d8b87bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf24e620-6438-4fb3-823f-37097a917e86', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2063090-75ef-437a-9d5b-41eefaa3218e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:31 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a Jul 07 18:02:31 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:31 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume volume-bf24e620-6438-4fb3-823f-37097a917e86 (bf24e620-6438-4fb3-823f-37097a917e86): created successfully Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2063090-75ef-437a-9d5b-41eefaa3218e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Flow 'volume_create_manager' (b7f4fd1e-6235-4bf2-85eb-06c2ade02438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:31 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b6af747e-1635-4ac8-96ab-04f734242a78 tempest-TestInstancesWithCinderVolumes-1444709625 None] Created volume successfully. Jul 07 18:02:32 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2316b2dd-26b6-4d03-8181-8d319c90339a" returned: 0 in 0.704s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-quobyte-2316b2dd-26b6-4d03-8181-8d319c90339a" released by "delete_volume" :: held 1.866s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Created reservations ['4d673b7a-6ea7-4491-bedd-da1ab569dfc0', 'd59cc7fb-ebd4-49d6-91e7-26def80f1a02', 'e18080d0-b604-4a33-bcec-4eb47107e7c4', 'c29c0bd1-29cb-48e8-b007-e2e2171cee89'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:32 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 1073741824" returned: 0 in 0.873s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:32 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:02:32 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:32 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 Jul 07 18:02:32 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:33 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.765s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Deleted volume successfully. Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22528102-b302-416e-98f1-14e11bde8932 tempest-VolumesDeleteCascade-507612943 None] Lock "cinder-2316b2dd-26b6-4d03-8181-8d319c90339a-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:33 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733" returned: 0 in 0.763s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=107,cinder:SELECT=91,cinder:INSERT=27,cinder:DELETE=7 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b85ab14-e39a-4805-93f7-2da6a6c66726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ba5e44-8740-41be-b159-c7d16c9de733', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431d7b41-6c48-4cd3-9bfd-ee7af069f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=86,cinder:INSERT=29,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:02:33 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume volume-b6ba5e44-8740-41be-b159-c7d16c9de733 (b6ba5e44-8740-41be-b159-c7d16c9de733): created successfully Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431d7b41-6c48-4cd3-9bfd-ee7af069f179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Flow 'volume_create_manager' (d6d33c5c-10c0-4b0c-9573-20107e4e4788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7b587b36-dbf6-4a80-8e87-e6756b877c2e tempest-TestInstancesWithCinderVolumes-1444709625 None] Created volume successfully. Jul 07 18:02:34 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD, size 20.69 MB, duration 3.71 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:02:34 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Image download 20.69 MB at 5.57 MB/s Jul 07 18:02:34 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ac1022-fd15-4649-b90e-6171782e1c79]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:34 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD Jul 07 18:02:34 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:35 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD" returned: 0 in 0.828s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Temporary image 198fbdb1-de6d-4420-9c92-10f9bea3abc9 is fetched for user d18cfa46418147eab3577a8ff7beb63c. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a82b212-e325-4bd9-a0b4-5aaf5370e1c5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:35 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD Jul 07 18:02:35 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Flow 'volume_create_manager' (57bd22e5-e778-4f92-b583-225ba796b43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ade5319-4087-4c61-b5db-4904abf7a479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ade5319-4087-4c61-b5db-4904abf7a479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-496394271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557a3496-06ce-4292-a290-77305c1e3a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93149c20ce194042ab3859db8e509b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:36Z,use_quota=True,user_id='bd910056a1484fe49d5ea6ba134a5498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1423ab61-382f-4354-91aa-6ef113fbace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1423ab61-382f-4354-91aa-6ef113fbace9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e979ad4-a4fc-4e25-a36d-72b6dc52bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e979ad4-a4fc-4e25-a36d-72b6dc52bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557a3496-06ce-4292-a290-77305c1e3a2d', 'volume_name': 'volume-557a3496-06ce-4292-a290-77305c1e3a2d', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc4170b-9753-49f4-9c44-718127d54e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc4170b-9753-49f4-9c44-718127d54e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d17f40-3f14-4a3b-83a7-0569235d5622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:35 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Volume 557a3496-06ce-4292-a290-77305c1e3a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557a3496-06ce-4292-a290-77305c1e3a2d', 'volume_size': 1} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-496394271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557a3496-06ce-4292-a290-77305c1e3a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93149c20ce194042ab3859db8e509b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:36Z,use_quota=True,user_id='bd910056a1484fe49d5ea6ba134a5498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Creating volume 557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:02:35 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:02:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:36 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d 1073741824 Jul 07 18:02:36 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:36 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD" returned: 0 in 0.794s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:36 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d 1073741824" returned: 0 in 0.776s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:36 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d Jul 07 18:02:36 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:37 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d" returned: 0 in 0.640s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-265198564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302d65ef-e334-43f2-88f6-418281ff224b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6989c7995e649e3b0c7b1031942f8c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:31Z,use_quota=True,user_id='d18cfa46418147eab3577a8ff7beb63c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(033ee810-c73b-4c68-b0a7-540fafee99ef),volume_type_id=033ee810-c73b-4c68-b0a7-540fafee99ef)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Creating volume 302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:02:37 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:37 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b 1073741824 Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d17f40-3f14-4a3b-83a7-0569235d5622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557a3496-06ce-4292-a290-77305c1e3a2d', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:37 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4c5cb5-8fa4-4774-84c6-60f2efaa6a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:37 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Volume volume-557a3496-06ce-4292-a290-77305c1e3a2d (557a3496-06ce-4292-a290-77305c1e3a2d): created successfully Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4c5cb5-8fa4-4774-84c6-60f2efaa6a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Flow 'volume_create_manager' (57bd22e5-e778-4f92-b583-225ba796b43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e6cdd834-fbb0-4e31-898a-7e495e22eb02 tempest-VolumesCloneTest-1148332921 None] Created volume successfully. Jul 07 18:02:38 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b 1073741824" returned: 0 in 0.815s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:38 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:02:38 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Flow 'volume_create_manager' (2b98451e-9f9b-4bc9-b9d2-f549196bccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51711915-ade7-4cd3-b303-df2c568042e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51711915-ade7-4cd3-b303-df2c568042e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2111551327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0645f4ed-5049-4667-b2dd-6a91f1a988ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93149c20ce194042ab3859db8e509b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=557a3496-06ce-4292-a290-77305c1e3a2d,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:38Z,use_quota=True,user_id='bd910056a1484fe49d5ea6ba134a5498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7609e5f-b06f-485f-8aec-7b843362da59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7609e5f-b06f-485f-8aec-7b843362da59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1106d5e6-6a75-4841-9539-c0647982f6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1106d5e6-6a75-4841-9539-c0647982f6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0645f4ed-5049-4667-b2dd-6a91f1a988ed', 'volume_name': 'volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed', 'volume_size': 2, 'source_volid': '557a3496-06ce-4292-a290-77305c1e3a2d', 'source_volstatus': 'available'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbab4a6-b66d-4cde-b0eb-14d7424bbaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbab4a6-b66d-4cde-b0eb-14d7424bbaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cc5e94-0da8-48c7-9ce7-ad8f298ffd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:38 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Volume 0645f4ed-5049-4667-b2dd-6a91f1a988ed: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed', 'volume_size': 2, 'source_volid': '557a3496-06ce-4292-a290-77305c1e3a2d', 'source_volstatus': 'available'} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:38 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 0 in 0.626s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.346s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:38 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Cloning volume 557a3496-06ce-4292-a290-77305c1e3a2d to volume 0645f4ed-5049-4667-b2dd-6a91f1a988ed Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Attempting download of 198fbdb1-de6d-4420-9c92-10f9bea3abc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'metadata': {}}])) to volume 302d65ef-e334-43f2-88f6-418281ff224b. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Creating offline snapshot 7be6d410-82ba-436e-8c0c-d92f4789319e of volume 557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacdb4a0-50cb-4575-9ecf-ed36cbb3fec1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:39 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d512603-935b-45dd-bc23-af994e41c414]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_198fbdb1-de6d-4420-9c92-10f9bea3abc9_oxg9x27g {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:39 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d Jul 07 18:02:39 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:39 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_198fbdb1-de6d-4420-9c92-10f9bea3abc9_oxg9x27g Jul 07 18:02:39 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:39 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_198fbdb1-de6d-4420-9c92-10f9bea3abc9_oxg9x27g" returned: 0 in 0.713s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_198fbdb1-de6d-4420-9c92-10f9bea3abc9_oxg9x27g {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:39 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d" returned: 0 in 0.740s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:39 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e 1G Jul 07 18:02:39 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:39 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_198fbdb1-de6d-4420-9c92-10f9bea3abc9_oxg9x27g Jul 07 18:02:39 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:40 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_198fbdb1-de6d-4420-9c92-10f9bea3abc9_oxg9x27g" returned: 1 in 0.702s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_198fbdb1-de6d-4420-9c92-10f9bea3abc9_oxg9x27g' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:02:40 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[121838a7-6c50-4b5a-89ae-8fbde86a4483]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:40 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e 1G" returned: 0 in 0.784s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557a3496-06ce-4292-a290-77305c1e3a2d -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:40 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD Jul 07 18:02:40 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:40 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557a3496-06ce-4292-a290-77305c1e3a2d -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e Jul 07 18:02:40 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:41 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:41 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] 198fbdb1-de6d-4420-9c92-10f9bea3abc9 was qcow2, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:02:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:41 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:02:41 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:41 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557a3496-06ce-4292-a290-77305c1e3a2d -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e" returned: 0 in 0.719s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:41 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e is being set with open permissions: ugo+rw Jul 07 18:02:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:41 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e Jul 07 18:02:41 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:41 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e" returned: 0 in 0.626s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:41 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.info Jul 07 18:02:41 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:42 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.info" returned: 0 in 0.691s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:42 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.info is being set with open permissions: ugo+rw Jul 07 18:02:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:42 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.info Jul 07 18:02:42 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:43 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 0 in 1.860s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_198fbdb1-de6d-4420-9c92-10f9bea3abc9_73xahgi2devstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:02:43 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Converted 112.00 MB image at 60.17 MB/s Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:43 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b 1G Jul 07 18:02:43 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:43 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.info" returned: 0 in 0.640s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Acquiring lock "cinder-quobyte-0645f4ed-5049-4667-b2dd-6a91f1a988ed" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Lock "cinder-quobyte-0645f4ed-5049-4667-b2dd-6a91f1a988ed" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] snapshot: 7be6d410-82ba-436e-8c0c-d92f4789319e, volume: 0645f4ed-5049-4667-b2dd-6a91f1a988ed, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[03195472-3c85-4aa0-ab01-d8b9145f83cb]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:43 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e Jul 07 18:02:43 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:43 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b 1G" returned: 0 in 0.704s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[11644f00-849c-43f8-b804-b522fec5abf0]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:43 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:02:43 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:44 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e" returned: 0 in 0.741s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557a3496-06ce-4292-a290-77305c1e3a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cebc6e4-fb2d-4a93-bb05-4fee1e508942]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:44 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d Jul 07 18:02:44 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:44 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 0 in 0.737s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:44 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:02:44 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:44 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d" returned: 0 in 0.787s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:02:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:44 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed Jul 07 18:02:44 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:45 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 1 in 0.720s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Downloaded image 198fbdb1-de6d-4420-9c92-10f9bea3abc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'metadata': {}}])) to volume 302d65ef-e334-43f2-88f6-418281ff224b successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Temporary image 198fbdb1-de6d-4420-9c92-10f9bea3abc9 for user d18cfa46418147eab3577a8ff7beb63c is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Marking volume 302d65ef-e334-43f2-88f6-418281ff224b as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Copying metadata from image 198fbdb1-de6d-4420-9c92-10f9bea3abc9 to 302d65ef-e334-43f2-88f6-418281ff224b. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Creating volume glance metadata for volume 302d65ef-e334-43f2-88f6-418281ff224b backed by image 198fbdb1-de6d-4420-9c92-10f9bea3abc9 with: {'image_id': '198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'image_name': 'tempest-scenario-img--668669325', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c74229-c461-45c5-9112-d5f834c8a15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302d65ef-e334-43f2-88f6-418281ff224b', 'volume_size': 1, 'image_id': '198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--668669325', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6989c7995e649e3b0c7b1031942f8c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '198fbdb1-de6d-4420-9c92-10f9bea3abc9', 'created_at': datetime.datetime(2026, 7, 7, 16, 2, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/198fbdb1-de6d-4420-9c92-10f9bea3abc9/file', 'properties': {}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0428b3-a644-4cf7-8d6c-51b4170ba871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:45 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Volume volume-302d65ef-e334-43f2-88f6-418281ff224b (302d65ef-e334-43f2-88f6-418281ff224b): created successfully Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0428b3-a644-4cf7-8d6c-51b4170ba871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Flow 'volume_create_manager' (9e5ce9d8-fa12-428a-a7a0-41417494a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-34730d95-668a-4e7c-8109-c7e2dcbe5f05 tempest-TestInstancesWithCinderVolumes-1444709625 None] Created volume successfully. Jul 07 18:02:49 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed" returned: 0 in 4.761s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e4c6f-5d17-40c7-aeeb-cfa6cf7e33ee]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:49 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d Jul 07 18:02:49 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:50 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d" returned: 0 in 0.889s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:50 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:02:50 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Converted 1024.00 MB image at 215.03 MB/s Jul 07 18:02:50 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed is being set with open permissions: ugo+rw Jul 07 18:02:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:50 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed Jul 07 18:02:50 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:51 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed" returned: 0 in 0.601s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Lock "cinder-quobyte-0645f4ed-5049-4667-b2dd-6a91f1a988ed" released by "_copy_volume_from_snapshot" :: held 7.864s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Acquiring lock "cinder-quobyte-7be6d410-82ba-436e-8c0c-d92f4789319e" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Lock "cinder-quobyte-7be6d410-82ba-436e-8c0c-d92f4789319e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Deleting offline snapshot 7be6d410-82ba-436e-8c0c-d92f4789319e of volume 557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] snapshot_file for this snap is: volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[120d0f2b-7280-4766-99bc-19c3c227b013]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:51 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e Jul 07 18:02:51 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:51 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e" returned: 0 in 0.711s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557a3496-06ce-4292-a290-77305c1e3a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1a4ba-fd37-474a-a768-c34c30edcda3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:52 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d Jul 07 18:02:52 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:52 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d" returned: 0 in 0.752s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:52 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e Jul 07 18:02:52 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:53 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e" returned: 0 in 0.824s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:53 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e Jul 07 18:02:53 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:54 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d.7be6d410-82ba-436e-8c0c-d92f4789319e" returned: 0 in 0.645s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Lock "cinder-quobyte-7be6d410-82ba-436e-8c0c-d92f4789319e" released by "_delete_snapshot" :: held 3.025s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.297s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cc5e94-0da8-48c7-9ce7-ad8f298ffd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed', 'volume_size': 2, 'source_volid': '557a3496-06ce-4292-a290-77305c1e3a2d', 'source_volstatus': 'available'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02417182-f396-41a7-9b33-ef850a53da93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:54 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Volume volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed (0645f4ed-5049-4667-b2dd-6a91f1a988ed): created successfully Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02417182-f396-41a7-9b33-ef850a53da93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Flow 'volume_create_manager' (2b98451e-9f9b-4bc9-b9d2-f549196bccb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-38d8382f-63ea-49f2-9a84-b3d94f204f6a tempest-VolumesCloneTest-1148332921 None] Created volume successfully. Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd125a9-f65c-44e6-a848-b8581e8467f9]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:54 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:02:54 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Acquiring lock "cinder-0645f4ed-5049-4667-b2dd-6a91f1a988ed-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Lock "cinder-0645f4ed-5049-4667-b2dd-6a91f1a988ed-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Acquiring lock "cinder-quobyte-0645f4ed-5049-4667-b2dd-6a91f1a988ed" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Lock "cinder-quobyte-0645f4ed-5049-4667-b2dd-6a91f1a988ed" acquired by "delete_volume" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[714d023a-492a-490e-988b-403f5c78c558]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:55 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed Jul 07 18:02:55 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:55 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 0 in 0.759s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:55 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:02:55 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:55 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed" returned: 0 in 0.787s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:55 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed Jul 07 18:02:55 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:55 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 1 in 0.760s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:02:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.560s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-302d65ef-e334-43f2-88f6-418281ff224b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b894df3d-2d20-4f4c-977d-0b261e73b422', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:02:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-01802722-d9da-4a14-ae48-3e10923558eb req-162b31b9-98ed-4ced-929c-08f987c177ce tempest-TestInstancesWithCinderVolumes-1444709625 None] attachment_update completed successfully. Jul 07 18:02:56 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-0645f4ed-5049-4667-b2dd-6a91f1a988ed" returned: 0 in 0.650s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Lock "cinder-quobyte-0645f4ed-5049-4667-b2dd-6a91f1a988ed" released by "delete_volume" :: held 1.483s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Created reservations ['0f26e5ad-979c-4ffa-b09c-0953785f81e8', 'd4a54faa-3a73-4d02-b252-538f89188380', 'c6e1523b-e121-4622-80ab-737456f23603', '74df231e-933e-433c-aaee-a1ee2d577835'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:56 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:02:56 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Acquiring lock "cinder-557a3496-06ce-4292-a290-77305c1e3a2d-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Lock "cinder-557a3496-06ce-4292-a290-77305c1e3a2d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:57 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.673s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Deleted volume successfully. Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Acquiring lock "cinder-quobyte-557a3496-06ce-4292-a290-77305c1e3a2d" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e64400e-54af-4dcd-91e8-1aedf08b8b3b tempest-VolumesCloneTest-1148332921 None] Lock "cinder-0645f4ed-5049-4667-b2dd-6a91f1a988ed-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Lock "cinder-quobyte-557a3496-06ce-4292-a290-77305c1e3a2d" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0013bd-f2f8-4384-be1e-5f28944e10e8]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:57 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d Jul 07 18:02:57 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:58 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d" returned: 0 in 0.761s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:58 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d Jul 07 18:02:58 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:58 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-557a3496-06ce-4292-a290-77305c1e3a2d" returned: 0 in 0.688s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Lock "cinder-quobyte-557a3496-06ce-4292-a290-77305c1e3a2d" released by "delete_volume" :: held 1.507s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Created reservations ['1174e00d-a359-4c5c-ae8c-7e4ecc1502d6', '6a6e58c7-9c17-4228-ade4-25e08b34ea7c', '909ca057-b1d7-47ea-bd18-bfa5c91514db', '687895d5-f486-44e6-b6c0-5afc21582d16'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:58 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:02:58 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:59 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.757s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:59 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Deleted volume successfully. Jul 07 18:03:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-347cb839-24b0-413f-8460-e704ea59ea78 tempest-VolumesCloneTest-1148332921 None] Lock "cinder-557a3496-06ce-4292-a290-77305c1e3a2d-delete_volume" released by "delete_volume" :: held 3.976s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=11,cinder:SELECT=29 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:03:09 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=29,cinder:UPDATE=31,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Flow 'volume_create_manager' (1ed4bca1-26c8-48ea-b204-7f80c4f75fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9aa481e-ad07-43f3-9157-8dede7c08dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9aa481e-ad07-43f3-9157-8dede7c08dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-589534947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e827ed63-4a4d-4299-ac53-3d42b4e679a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dcc39f24a5b14765950d8b10fb9aa9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:11Z,use_quota=True,user_id='cc11580824044d0db71f1535121609e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb43c179-ceca-4e7c-bd3b-5172face3406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb43c179-ceca-4e7c-bd3b-5172face3406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfef63a2-abb7-4f82-a50b-aae17e2620cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfef63a2-abb7-4f82-a50b-aae17e2620cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e827ed63-4a4d-4299-ac53-3d42b4e679a5', 'volume_name': 'volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c32443-3042-4e6a-a29d-683912e9b472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c32443-3042-4e6a-a29d-683912e9b472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05d337f-60ff-4616-8b3e-fffc1d691d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:11 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Volume e827ed63-4a4d-4299-ac53-3d42b4e679a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5', 'volume_size': 1} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-589534947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e827ed63-4a4d-4299-ac53-3d42b4e679a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dcc39f24a5b14765950d8b10fb9aa9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:11Z,use_quota=True,user_id='cc11580824044d0db71f1535121609e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Creating volume e827ed63-4a4d-4299-ac53-3d42b4e679a5 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:11 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:03:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:11 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 1073741824 Jul 07 18:03:11 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:12 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 1073741824" returned: 0 in 0.945s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:12 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 Jul 07 18:03:12 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:12 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5" returned: 0 in 0.679s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05d337f-60ff-4616-8b3e-fffc1d691d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00c5c37-8953-4c9e-ac1f-f9cda33fea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:12 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Volume volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 (e827ed63-4a4d-4299-ac53-3d42b4e679a5): created successfully Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00c5c37-8953-4c9e-ac1f-f9cda33fea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:12 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Flow 'volume_create_manager' (1ed4bca1-26c8-48ea-b204-7f80c4f75fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:12 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a48803cc-8db7-47a2-869e-fe997a4f6edb tempest-VolumesListTestJSON-1541761196 None] Created volume successfully. Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Flow 'volume_create_manager' (11cd7074-38e7-4782-84b8-f39c1b6d21ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7219954-2aa9-4667-b5c9-62ec32a3f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7219954-2aa9-4667-b5c9-62ec32a3f963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2067734649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ecba4d2-142e-4869-962f-2b6d620de239,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dcc39f24a5b14765950d8b10fb9aa9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:14Z,use_quota=True,user_id='cc11580824044d0db71f1535121609e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103fe661-cb89-4a6e-bf29-ecb6deab43d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103fe661-cb89-4a6e-bf29-ecb6deab43d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db49cfa8-fac3-4d71-9f9b-75fa5ec5fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db49cfa8-fac3-4d71-9f9b-75fa5ec5fef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ecba4d2-142e-4869-962f-2b6d620de239', 'volume_name': 'volume-4ecba4d2-142e-4869-962f-2b6d620de239', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bedafe8-cb01-4d91-b288-e5f38ce8e762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bedafe8-cb01-4d91-b288-e5f38ce8e762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba385f1-803b-4d92-b3e9-7acb6c6e0386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:13 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Volume 4ecba4d2-142e-4869-962f-2b6d620de239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ecba4d2-142e-4869-962f-2b6d620de239', 'volume_size': 1} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2067734649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ecba4d2-142e-4869-962f-2b6d620de239,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dcc39f24a5b14765950d8b10fb9aa9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:14Z,use_quota=True,user_id='cc11580824044d0db71f1535121609e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Creating volume 4ecba4d2-142e-4869-962f-2b6d620de239 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:13 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:03:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:13 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 1073741824 Jul 07 18:03:13 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:14 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 1073741824" returned: 0 in 0.819s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:14 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 Jul 07 18:03:14 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:15 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239" returned: 0 in 0.616s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba385f1-803b-4d92-b3e9-7acb6c6e0386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ecba4d2-142e-4869-962f-2b6d620de239', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e422ebe4-35d7-4478-83c2-f3dc067620e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Volume volume-4ecba4d2-142e-4869-962f-2b6d620de239 (4ecba4d2-142e-4869-962f-2b6d620de239): created successfully Jul 07 18:03:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e422ebe4-35d7-4478-83c2-f3dc067620e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Flow 'volume_create_manager' (11cd7074-38e7-4782-84b8-f39c1b6d21ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:15 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-04c38191-7ee1-45a8-a354-7fcd5e49c541 tempest-VolumesListTestJSON-1541761196 None] Created volume successfully. Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Flow 'volume_create_manager' (1aeb10bd-5914-47a2-bf3c-06b2e2be4d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1677e703-79bf-4451-8905-7207d954940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1677e703-79bf-4451-8905-7207d954940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-987348448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ae0855-1077-4987-99a8-1b777c9ab3fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dcc39f24a5b14765950d8b10fb9aa9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:16Z,use_quota=True,user_id='cc11580824044d0db71f1535121609e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162dbfcb-54ac-411b-acbb-4f99840478f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162dbfcb-54ac-411b-acbb-4f99840478f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5e42c3-dce3-45c2-814b-30a9ab68f3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5e42c3-dce3-45c2-814b-30a9ab68f3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ae0855-1077-4987-99a8-1b777c9ab3fb', 'volume_name': 'volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef569134-788a-4829-9958-9d30fbc91c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef569134-788a-4829-9958-9d30fbc91c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6553e382-b2ab-4f94-aa33-322351e211af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:16 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Volume c0ae0855-1077-4987-99a8-1b777c9ab3fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb', 'volume_size': 1} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-987348448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ae0855-1077-4987-99a8-1b777c9ab3fb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dcc39f24a5b14765950d8b10fb9aa9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:16Z,use_quota=True,user_id='cc11580824044d0db71f1535121609e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Creating volume c0ae0855-1077-4987-99a8-1b777c9ab3fb {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:16 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:03:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:16 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb 1073741824 Jul 07 18:03:16 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:17 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb 1073741824" returned: 0 in 0.829s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:17 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb Jul 07 18:03:17 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:17 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb" returned: 0 in 0.604s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6553e382-b2ab-4f94-aa33-322351e211af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6405c2f-bbd6-4344-bb7c-6e43bc044657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:17 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Volume volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb (c0ae0855-1077-4987-99a8-1b777c9ab3fb): created successfully Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6405c2f-bbd6-4344-bb7c-6e43bc044657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Flow 'volume_create_manager' (1aeb10bd-5914-47a2-bf3c-06b2e2be4d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:17 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7c0df02d-e825-4a8e-9eff-c3c81671847a tempest-VolumesListTestJSON-1541761196 None] Created volume successfully. Jul 07 18:03:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "cinder-c0ae0855-1077-4987-99a8-1b777c9ab3fb-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-c0ae0855-1077-4987-99a8-1b777c9ab3fb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "cinder-quobyte-c0ae0855-1077-4987-99a8-1b777c9ab3fb" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-quobyte-c0ae0855-1077-4987-99a8-1b777c9ab3fb" acquired by "delete_volume" :: waited 0.013s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a305a64-5c4d-4246-b0d2-a30d511d3637]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:20 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb Jul 07 18:03:20 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:20 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb" returned: 0 in 0.727s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:20 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb Jul 07 18:03:20 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:21 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c0ae0855-1077-4987-99a8-1b777c9ab3fb" returned: 0 in 0.601s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-quobyte-c0ae0855-1077-4987-99a8-1b777c9ab3fb" released by "delete_volume" :: held 1.366s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Created reservations ['83de4994-bd60-4e21-aaaf-b7d82d92711a', '53eb3661-da74-434b-96f9-44f448351dad', '0aaf605a-f006-4d91-b448-9b2eef16bcc9', 'd63a429c-acef-4edf-a977-50e37de962d9'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:21 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:03:21 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:22 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.658s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:03:22 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Deleted volume successfully. Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b4419e1c-14d0-44d0-9824-66eec5192451 tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-c0ae0855-1077-4987-99a8-1b777c9ab3fb-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "cinder-4ecba4d2-142e-4869-962f-2b6d620de239-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-4ecba4d2-142e-4869-962f-2b6d620de239-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "cinder-quobyte-4ecba4d2-142e-4869-962f-2b6d620de239" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-quobyte-4ecba4d2-142e-4869-962f-2b6d620de239" acquired by "delete_volume" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1909b-29e0-434f-a8af-5002181f2685]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:22 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 Jul 07 18:03:22 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:23 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239" returned: 0 in 0.781s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:23 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239 Jul 07 18:03:23 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:23 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:03:23 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:23 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-4ecba4d2-142e-4869-962f-2b6d620de239" returned: 0 in 0.688s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-quobyte-4ecba4d2-142e-4869-962f-2b6d620de239" released by "delete_volume" :: held 1.542s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Created reservations ['d06bce0b-9467-4fc0-81db-99b541aca591', '03ecd0ae-1314-428b-9e76-91550d4fde66', '42c60df0-d227-46fe-98ce-92ad46a178d9', '351c014e-8a8b-4e8d-9d07-74450b95c4a1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:24 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:03:24 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:24 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.737s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "cinder-e827ed63-4a4d-4299-ac53-3d42b4e679a5-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-e827ed63-4a4d-4299-ac53-3d42b4e679a5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "cinder-quobyte-e827ed63-4a4d-4299-ac53-3d42b4e679a5" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-quobyte-e827ed63-4a4d-4299-ac53-3d42b4e679a5" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f6b168-a4d7-4d3a-a2f3-1304a6ecba95]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:24 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.721s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:03:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Deleted volume successfully. Jul 07 18:03:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-de1e4a86-b3ba-42a6-b159-8d50d35160fb tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-4ecba4d2-142e-4869-962f-2b6d620de239-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:24 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 Jul 07 18:03:24 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:25 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5" returned: 0 in 0.811s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:25 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5 Jul 07 18:03:25 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:26 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e827ed63-4a4d-4299-ac53-3d42b4e679a5" returned: 0 in 0.640s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-quobyte-e827ed63-4a4d-4299-ac53-3d42b4e679a5" released by "delete_volume" :: held 1.501s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Created reservations ['ff0823c9-7540-4027-951e-4104b542a7ee', '54f22434-f3d3-44d4-87fa-d650b38f7560', '79a3d8ee-4622-4d91-8e03-aafdacbd554f', '97fbc37d-8ca0-47ef-a84a-b87034dc5d49'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:26 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:03:26 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:27 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.652s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:27 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:03:27 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Deleted volume successfully. Jul 07 18:03:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6fef7615-26fb-440a-b01a-3d4c4dca4f33 tempest-VolumesListTestJSON-1541761196 None] Lock "cinder-e827ed63-4a4d-4299-ac53-3d42b4e679a5-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-a3d34ac1-4be7-43b6-9c44-2b0a93e919d7 req-f75b94a3-c4af-4264-9b60-36d6e9814d5e tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-a3d34ac1-4be7-43b6-9c44-2b0a93e919d7 req-f75b94a3-c4af-4264-9b60-36d6e9814d5e tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:29 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98a5ce9-8ebe-4d85-9412-ef54e89ac106]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-a3d34ac1-4be7-43b6-9c44-2b0a93e919d7 req-f75b94a3-c4af-4264-9b60-36d6e9814d5e tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:29 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 Jul 07 18:03:29 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:30 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-a3d34ac1-4be7-43b6-9c44-2b0a93e919d7 req-f75b94a3-c4af-4264-9b60-36d6e9814d5e tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86" returned: 0 in 0.844s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-a3d34ac1-4be7-43b6-9c44-2b0a93e919d7 req-f75b94a3-c4af-4264-9b60-36d6e9814d5e tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.864s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-a3d34ac1-4be7-43b6-9c44-2b0a93e919d7 req-f75b94a3-c4af-4264-9b60-36d6e9814d5e tempest-TestInstancesWithCinderVolumes-1444709625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-bf24e620-6438-4fb3-823f-37097a917e86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7393d807-b888-4935-ab3c-21539253252d', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:03:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-a3d34ac1-4be7-43b6-9c44-2b0a93e919d7 req-f75b94a3-c4af-4264-9b60-36d6e9814d5e tempest-TestInstancesWithCinderVolumes-1444709625 None] attachment_update completed successfully. Jul 07 18:03:40 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=28,cinder:UPDATE=37,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:03:40 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=33,cinder:SELECT=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:03:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-17adaf49-00f0-45e1-8810-915de18c8e72 req-dcdc99d2-58ee-4616-9d96-28539758718e tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-17adaf49-00f0-45e1-8810-915de18c8e72 req-dcdc99d2-58ee-4616-9d96-28539758718e tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bf20bd-90bf-4c0e-a140-0cba739ae0b0]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-17adaf49-00f0-45e1-8810-915de18c8e72 req-dcdc99d2-58ee-4616-9d96-28539758718e tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:41 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 Jul 07 18:03:41 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:41 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-17adaf49-00f0-45e1-8810-915de18c8e72 req-dcdc99d2-58ee-4616-9d96-28539758718e tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733" returned: 0 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-17adaf49-00f0-45e1-8810-915de18c8e72 req-dcdc99d2-58ee-4616-9d96-28539758718e tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.902s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-17adaf49-00f0-45e1-8810-915de18c8e72 req-dcdc99d2-58ee-4616-9d96-28539758718e tempest-TestInstancesWithCinderVolumes-1444709625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-b6ba5e44-8740-41be-b159-c7d16c9de733', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a99be9a0-bb95-4518-b4cb-4714f86c557e', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:03:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-17adaf49-00f0-45e1-8810-915de18c8e72 req-dcdc99d2-58ee-4616-9d96-28539758718e tempest-TestInstancesWithCinderVolumes-1444709625 None] attachment_update completed successfully. Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (6c40b8b9-cef0-45c4-872a-327ec800ea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654cfa67-9fd5-45bb-ae88-47916c48b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654cfa67-9fd5-45bb-ae88-47916c48b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-881487246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902b0152-978c-4a96-bbda-3528fe07d21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e559df06c4518a2392682a09c4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:42Z,use_quota=True,user_id='0ab33de84d1d456598911c0811c23119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e91e6d-7f78-4d9a-9071-7524cb194301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e91e6d-7f78-4d9a-9071-7524cb194301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1811e1f0-ef04-4136-b8c2-96309b372940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1811e1f0-ef04-4136-b8c2-96309b372940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902b0152-978c-4a96-bbda-3528fe07d21f', 'volume_name': 'volume-902b0152-978c-4a96-bbda-3528fe07d21f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f151e94-1e77-4921-9c96-7427f37370f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f151e94-1e77-4921-9c96-7427f37370f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d585ef-834e-40d9-9fde-b2798e42f38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:42 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Volume 902b0152-978c-4a96-bbda-3528fe07d21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902b0152-978c-4a96-bbda-3528fe07d21f', 'volume_size': 1} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-881487246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902b0152-978c-4a96-bbda-3528fe07d21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e559df06c4518a2392682a09c4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:42Z,use_quota=True,user_id='0ab33de84d1d456598911c0811c23119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Creating volume 902b0152-978c-4a96-bbda-3528fe07d21f {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:42 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:03:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:42 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f 1073741824 Jul 07 18:03:42 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:43 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f 1073741824" returned: 0 in 0.847s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:43 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f Jul 07 18:03:43 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:44 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f" returned: 0 in 0.635s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d585ef-834e-40d9-9fde-b2798e42f38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902b0152-978c-4a96-bbda-3528fe07d21f', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222a66bf-c7ac-4acc-bddd-d4c92db4e139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:44 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Volume volume-902b0152-978c-4a96-bbda-3528fe07d21f (902b0152-978c-4a96-bbda-3528fe07d21f): created successfully Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (222a66bf-c7ac-4acc-bddd-d4c92db4e139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (6c40b8b9-cef0-45c4-872a-327ec800ea82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b23e5c38-be17-4803-a63c-8a0128da307d tempest-VolumesSnapshotTestJSON-430285352 None] Created volume successfully. Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Creating offline snapshot 25e95007-bbaf-4c3f-a549-444c8f8b69ac of volume 902b0152-978c-4a96-bbda-3528fe07d21f {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[418fe314-cafd-4c9c-a0ea-0b9ec4e4b83c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:44 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f Jul 07 18:03:44 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:45 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f" returned: 0 in 0.746s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:45 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac 1G Jul 07 18:03:45 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:46 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac 1G" returned: 0 in 0.775s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902b0152-978c-4a96-bbda-3528fe07d21f -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:46 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902b0152-978c-4a96-bbda-3528fe07d21f -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac Jul 07 18:03:46 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:47 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-902b0152-978c-4a96-bbda-3528fe07d21f -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac" returned: 0 in 0.690s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:47 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac is being set with open permissions: ugo+rw Jul 07 18:03:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:47 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac Jul 07 18:03:47 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:47 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac" returned: 0 in 0.682s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:47 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.info Jul 07 18:03:47 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:48 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.info" returned: 0 in 0.662s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:48 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.info is being set with open permissions: ugo+rw Jul 07 18:03:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:48 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.info Jul 07 18:03:48 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:49 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.info" returned: 0 in 0.647s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.298s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1a1dc639-d291-4c05-8746-405f83d99163 tempest-VolumesSnapshotTestJSON-430285352 None] Create snapshot completed successfully Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-25e95007-bbaf-4c3f-a549-444c8f8b69ac-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-25e95007-bbaf-4c3f-a549-444c8f8b69ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-902b0152-978c-4a96-bbda-3528fe07d21f" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-902b0152-978c-4a96-bbda-3528fe07d21f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-25e95007-bbaf-4c3f-a549-444c8f8b69ac" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-25e95007-bbaf-4c3f-a549-444c8f8b69ac" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Deleting offline snapshot 25e95007-bbaf-4c3f-a549-444c8f8b69ac of volume 902b0152-978c-4a96-bbda-3528fe07d21f {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] snapshot_file for this snap is: volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3626e4-1482-4d5e-94b8-62b094d9a625]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:50 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac Jul 07 18:03:50 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:51 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac" returned: 0 in 0.742s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-902b0152-978c-4a96-bbda-3528fe07d21f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:03:51 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c50a573-503d-47f4-bbb9-b27b6fd7ac5b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:51 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f Jul 07 18:03:51 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-cfee5f9d-96fe-4421-8eed-18a16b944d41 req-5b06d7f1-44d8-4085-b6cc-efea4d8d486d tempest-TestInstancesWithCinderVolumes-1444709625 None] Terminate volume connection completed successfully. Jul 07 18:03:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-cfee5f9d-96fe-4421-8eed-18a16b944d41 req-5b06d7f1-44d8-4085-b6cc-efea4d8d486d tempest-TestInstancesWithCinderVolumes-1444709625 None] Deleting attachment 7393d807-b888-4935-ab3c-21539253252d. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:03:51 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f" returned: 0 in 0.746s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:51 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac Jul 07 18:03:51 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:52 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac" returned: 0 in 0.766s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:52 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac Jul 07 18:03:52 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:53 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f.25e95007-bbaf-4c3f-a549-444c8f8b69ac" returned: 0 in 0.624s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-25e95007-bbaf-4c3f-a549-444c8f8b69ac" released by "_delete_snapshot" :: held 2.986s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-902b0152-978c-4a96-bbda-3528fe07d21f" released by "delete_snapshot" :: held 3.009s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Created reservations ['34f18132-6bea-4857-948c-bb9d27d4cffe', 'c916440b-22f9-4a10-b254-4217ae5e03b6', '01bd2544-79b5-462d-b7c3-ac7c9addc0d8', '9c18cb43-f8b4-4eec-b868-241f711d23c7'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "cinder-bf24e620-6438-4fb3-823f-37097a917e86-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-bf24e620-6438-4fb3-823f-37097a917e86-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Delete snapshot completed successfully. Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5de0f503-3dce-4759-b12d-346b15e6f2cd tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-25e95007-bbaf-4c3f-a549-444c8f8b69ac-delete_snapshot" released by "delete_snapshot" :: held 3.222s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "cinder-quobyte-bf24e620-6438-4fb3-823f-37097a917e86" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-quobyte-bf24e620-6438-4fb3-823f-37097a917e86" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5106e069-5f35-402f-be72-2465439f6c17]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:53 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 Jul 07 18:03:53 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:54 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86" returned: 0 in 0.844s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:54 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86 Jul 07 18:03:54 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:55 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bf24e620-6438-4fb3-823f-37097a917e86" returned: 0 in 0.728s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-quobyte-bf24e620-6438-4fb3-823f-37097a917e86" released by "delete_volume" :: held 1.616s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (c0997594-2258-477d-a543-0f75d5b319ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c7c35f-b760-4204-b133-855d474bd359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c7c35f-b760-4204-b133-855d474bd359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1893834650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd5ebdf-df23-47f8-85cd-665e350a6708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e559df06c4518a2392682a09c4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:55Z,use_quota=True,user_id='0ab33de84d1d456598911c0811c23119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73354aea-b026-44b9-9750-210e96bc0590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73354aea-b026-44b9-9750-210e96bc0590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7275e873-d710-40b5-9c61-99837475f0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7275e873-d710-40b5-9c61-99837475f0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd5ebdf-df23-47f8-85cd-665e350a6708', 'volume_name': 'volume-fbd5ebdf-df23-47f8-85cd-665e350a6708', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a14d3f4-d7d8-4920-a0d6-be6a7a69f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a14d3f4-d7d8-4920-a0d6-be6a7a69f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92a9970-27a7-485d-a96e-735b165ff62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:55 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Volume fbd5ebdf-df23-47f8-85cd-665e350a6708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd5ebdf-df23-47f8-85cd-665e350a6708', 'volume_size': 1} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1893834650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbd5ebdf-df23-47f8-85cd-665e350a6708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e559df06c4518a2392682a09c4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:55Z,use_quota=True,user_id='0ab33de84d1d456598911c0811c23119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Creating volume fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:55 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:55 devstack cinder-volume[87228]: WARNING cinder.quota [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-366753319-1548864410 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-366753319-1548864410, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:03:55 devstack cinder-volume[87228]: WARNING cinder.quota [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-366753319-1548864410 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-366753319-1548864410, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:03:55 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 1073741824 Jul 07 18:03:55 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Created reservations ['5582538b-f597-4d9a-8558-5210a1fe4472', '6370a214-c676-48f8-9074-a1f14dfd88a2', '7b30057d-0d38-4e5b-b172-af6e9ae99a7f', '1eb81a0e-2327-41a7-8532-eb4650c1e1b2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:55 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:03:55 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:56 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.686s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:03:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Deleted volume successfully. Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4892ddd-adb0-4479-92a0-8138cadd10c2 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-bf24e620-6438-4fb3-823f-37097a917e86-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:56 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 1073741824" returned: 0 in 0.944s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:56 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 Jul 07 18:03:56 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:56 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708" returned: 0 in 0.643s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92a9970-27a7-485d-a96e-735b165ff62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd5ebdf-df23-47f8-85cd-665e350a6708', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661eb47d-f712-40bb-8246-3be4da2149e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:56 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Volume volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 (fbd5ebdf-df23-47f8-85cd-665e350a6708): created successfully Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661eb47d-f712-40bb-8246-3be4da2149e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (c0997594-2258-477d-a543-0f75d5b319ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2886bb2a-1400-499d-a457-bb19d6a025b7 tempest-VolumesSnapshotTestJSON-430285352 None] Created volume successfully. Jul 07 18:03:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Creating offline snapshot 271475de-176a-4538-99ba-5a151373ef3c of volume fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:03:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[302b009b-ac5a-4a04-8ad2-f29ea083f298]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:57 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 Jul 07 18:03:57 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-f9b6810d-2516-4486-b4ba-e5bf1435ea02 req-0c083756-7d2b-4478-a645-a5068a984e97 tempest-TestInstancesWithCinderVolumes-1444709625 None] Terminate volume connection completed successfully. Jul 07 18:03:57 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-f9b6810d-2516-4486-b4ba-e5bf1435ea02 req-0c083756-7d2b-4478-a645-a5068a984e97 tempest-TestInstancesWithCinderVolumes-1444709625 None] Deleting attachment a99be9a0-bb95-4518-b4cb-4714f86c557e. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:03:58 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708" returned: 0 in 0.776s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:58 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c 1G Jul 07 18:03:58 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:58 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c 1G" returned: 0 in 0.779s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:58 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c Jul 07 18:03:58 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:59 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c" returned: 0 in 0.711s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:59 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c is being set with open permissions: ugo+rw Jul 07 18:03:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:59 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c Jul 07 18:03:59 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "cinder-b6ba5e44-8740-41be-b159-c7d16c9de733-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-b6ba5e44-8740-41be-b159-c7d16c9de733-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "cinder-quobyte-b6ba5e44-8740-41be-b159-c7d16c9de733" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-quobyte-b6ba5e44-8740-41be-b159-c7d16c9de733" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ede07a7-27e6-4553-8248-21df979e8cfa]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:00 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 Jul 07 18:04:00 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:00 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c" returned: 0 in 0.684s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:00 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.info Jul 07 18:04:00 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:00 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733" returned: 0 in 0.817s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:00 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733 Jul 07 18:04:00 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:01 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.info" returned: 0 in 0.717s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:01 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.info is being set with open permissions: ugo+rw Jul 07 18:04:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:01 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.info Jul 07 18:04:01 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:01 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b6ba5e44-8740-41be-b159-c7d16c9de733" returned: 0 in 0.761s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-quobyte-b6ba5e44-8740-41be-b159-c7d16c9de733" released by "delete_volume" :: held 1.634s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:01 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.info" returned: 0 in 0.667s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.457s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:02 devstack cinder-volume[87228]: WARNING cinder.quota [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613887077-2028567521 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613887077-2028567521, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:04:02 devstack cinder-volume[87228]: WARNING cinder.quota [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613887077-2028567521 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-613887077-2028567521, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:04:02 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f3a67318-6bdb-4cdf-b108-939f75ed9f65 tempest-VolumesSnapshotTestJSON-430285352 None] Create snapshot completed successfully Jul 07 18:04:02 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Created reservations ['f02def01-f67f-432e-b7de-86275670d932', 'b62c2a3c-e944-47e7-8922-5c8ccdf327a5', 'f409b710-0e19-49d2-a281-8337b4592a1f', '39427dfd-0fd6-4101-9aab-ad1e0a6ce9fc'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:02 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:04:02 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:03 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.644s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:03 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Deleted volume successfully. Jul 07 18:04:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-62440843-b882-4045-bf9d-81f543e18ef7 tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-b6ba5e44-8740-41be-b159-c7d16c9de733-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:06 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:04:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (78440878-2436-4b39-8fa6-a54b2f98ec1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416bc65f-eda6-441f-88e1-e802d4f3afa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416bc65f-eda6-441f-88e1-e802d4f3afa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2139630125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3d6241-6059-4620-8e06-042c81a03b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e559df06c4518a2392682a09c4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=271475de-176a-4538-99ba-5a151373ef3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:05Z,use_quota=True,user_id='0ab33de84d1d456598911c0811c23119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24db8f7f-cdc7-46ae-8b08-a5c0cf5b1dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24db8f7f-cdc7-46ae-8b08-a5c0cf5b1dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebbe41c-0e96-46eb-a634-07d984933e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebbe41c-0e96-46eb-a634-07d984933e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed3d6241-6059-4620-8e06-042c81a03b19', 'volume_name': 'volume-ed3d6241-6059-4620-8e06-042c81a03b19', 'volume_size': 2, 'snapshot_id': '271475de-176a-4538-99ba-5a151373ef3c'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c047052-04d3-4ee2-b2ec-6afaac5244c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c047052-04d3-4ee2-b2ec-6afaac5244c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fea52d8-8b59-4605-aa43-1774dafacfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:07 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Volume ed3d6241-6059-4620-8e06-042c81a03b19: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed3d6241-6059-4620-8e06-042c81a03b19', 'volume_size': 2, 'snapshot_id': '271475de-176a-4538-99ba-5a151373ef3c'} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-271475de-176a-4538-99ba-5a151373ef3c-ed3d6241-6059-4620-8e06-042c81a03b19" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-271475de-176a-4538-99ba-5a151373ef3c-ed3d6241-6059-4620-8e06-042c81a03b19" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Creating volume ed3d6241-6059-4620-8e06-042c81a03b19 from snapshot 271475de-176a-4538-99ba-5a151373ef3c {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-ed3d6241-6059-4620-8e06-042c81a03b19" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-ed3d6241-6059-4620-8e06-042c81a03b19" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] snapshot: 271475de-176a-4538-99ba-5a151373ef3c, volume: ed3d6241-6059-4620-8e06-042c81a03b19, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e0359-581e-4f2c-9018-ff9d2c544661]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:07 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c Jul 07 18:04:07 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:07 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c" returned: 0 in 0.739s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbd5ebdf-df23-47f8-85cd-665e350a6708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bdc7d0-23bc-4196-b765-6e79fafe9aa4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:07 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 Jul 07 18:04:07 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:08 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708" returned: 0 in 0.757s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:08 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:04:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:08 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 Jul 07 18:04:08 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:11 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-b0b3f8ba-df22-4070-9a02-9f55ce43b12c req-c8135909-5399-479a-9d29-9421add93b76 tempest-TestInstancesWithCinderVolumes-1444709625 None] Terminate volume connection completed successfully. Jul 07 18:04:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-b0b3f8ba-df22-4070-9a02-9f55ce43b12c req-c8135909-5399-479a-9d29-9421add93b76 tempest-TestInstancesWithCinderVolumes-1444709625 None] Deleting attachment b894df3d-2d20-4f4c-977d-0b261e73b422. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:04:13 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19" returned: 0 in 4.657s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:13 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd66c1-a9f9-4abe-8a9d-31b295a12182]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:13 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 Jul 07 18:04:13 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:14 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708" returned: 0 in 0.882s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:04:14 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Converted 1024.00 MB image at 219.84 MB/s Jul 07 18:04:14 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 is being set with open permissions: ugo+rw Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:14 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 Jul 07 18:04:14 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:14 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19" returned: 0 in 0.600s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-ed3d6241-6059-4620-8e06-042c81a03b19" released by "_copy_volume_from_snapshot" :: held 7.735s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-271475de-176a-4538-99ba-5a151373ef3c-ed3d6241-6059-4620-8e06-042c81a03b19" released by "_create_volume_from_snapshot" :: held 7.763s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.778s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fea52d8-8b59-4605-aa43-1774dafacfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3d6241-6059-4620-8e06-042c81a03b19', 'volume_size': 2, 'snapshot_id': '271475de-176a-4538-99ba-5a151373ef3c'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcf4491-4bad-4165-ac61-0b4c83367eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:14 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Volume volume-ed3d6241-6059-4620-8e06-042c81a03b19 (ed3d6241-6059-4620-8e06-042c81a03b19): created successfully Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bcf4491-4bad-4165-ac61-0b4c83367eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (78440878-2436-4b39-8fa6-a54b2f98ec1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-389e8c78-d4b6-440f-aa7e-ac0a12bcf570 tempest-VolumesSnapshotTestJSON-430285352 None] Created volume successfully. Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "cinder-302d65ef-e334-43f2-88f6-418281ff224b-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-302d65ef-e334-43f2-88f6-418281ff224b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "cinder-quobyte-302d65ef-e334-43f2-88f6-418281ff224b" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-quobyte-302d65ef-e334-43f2-88f6-418281ff224b" acquired by "delete_volume" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[59716bd9-a117-4170-af33-edc7210aa033]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:15 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:04:15 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:15 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 0 in 0.716s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-ed3d6241-6059-4620-8e06-042c81a03b19-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-ed3d6241-6059-4620-8e06-042c81a03b19-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:15 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:04:15 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-ed3d6241-6059-4620-8e06-042c81a03b19" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-ed3d6241-6059-4620-8e06-042c81a03b19" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabfaf39-bd24-49e1-af82-9005203c7b3e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:16 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 Jul 07 18:04:16 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:16 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 1 in 0.753s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:04:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:16 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b Jul 07 18:04:16 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:16 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19" returned: 0 in 0.746s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:16 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19 Jul 07 18:04:16 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:17 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-302d65ef-e334-43f2-88f6-418281ff224b" returned: 0 in 0.660s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-quobyte-302d65ef-e334-43f2-88f6-418281ff224b" released by "delete_volume" :: held 2.188s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:17 devstack cinder-volume[87228]: WARNING cinder.quota [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-60146711-2099685800 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-60146711-2099685800, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:04:17 devstack cinder-volume[87228]: WARNING cinder.quota [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-60146711-2099685800 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-60146711-2099685800, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Created reservations ['790e0307-7064-4281-80ee-666ecbdd1725', 'b3949a31-9e5b-43b1-8701-02aacc3b934c', 'fa856a7c-c021-4f16-a0c0-3ab642b71d20', 'b12264f7-9cb3-415e-a1f2-e65da5aab0c2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:17 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ed3d6241-6059-4620-8e06-042c81a03b19" returned: 0 in 0.681s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:17 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:04:17 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-ed3d6241-6059-4620-8e06-042c81a03b19" released by "delete_volume" :: held 1.478s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Created reservations ['e2615ed3-354e-433c-b197-f2933fc2b2e9', 'd74a6ae5-2619-45a8-a4c5-8a8e03a3e0d3', 'a568405c-54bf-46fc-9a63-9d9dd1758fb2', '3b1621da-3a43-4039-8739-438b1857aa93'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:17 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:04:17 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:17 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.628s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:17 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:17 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Deleted volume successfully. Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-156574d6-5efa-4261-907d-596c0a4a9bed tempest-TestInstancesWithCinderVolumes-1444709625 None] Lock "cinder-302d65ef-e334-43f2-88f6-418281ff224b-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-271475de-176a-4538-99ba-5a151373ef3c-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-271475de-176a-4538-99ba-5a151373ef3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-fbd5ebdf-df23-47f8-85cd-665e350a6708" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-fbd5ebdf-df23-47f8-85cd-665e350a6708" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-271475de-176a-4538-99ba-5a151373ef3c" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-271475de-176a-4538-99ba-5a151373ef3c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Deleting offline snapshot 271475de-176a-4538-99ba-5a151373ef3c of volume fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] snapshot_file for this snap is: volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa802ae-ccf2-4c47-bca2-a726ceb14174]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:18 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.785s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:18 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Deleted volume successfully. Jul 07 18:04:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-159da238-c9a4-4263-8a51-4446afda1640 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-ed3d6241-6059-4620-8e06-042c81a03b19-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:18 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c Jul 07 18:04:18 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:19 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c" returned: 0 in 0.830s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbd5ebdf-df23-47f8-85cd-665e350a6708(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:04:19 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3574acfd-10d5-4d66-9ccc-d720ac547a60]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:19 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 Jul 07 18:04:19 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:19 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708" returned: 0 in 0.789s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:19 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c Jul 07 18:04:19 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:20 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c" returned: 0 in 0.739s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:20 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c Jul 07 18:04:20 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:21 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708.271475de-176a-4538-99ba-5a151373ef3c" returned: 0 in 0.722s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-271475de-176a-4538-99ba-5a151373ef3c" released by "_delete_snapshot" :: held 3.203s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-fbd5ebdf-df23-47f8-85cd-665e350a6708" released by "delete_snapshot" :: held 3.228s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:21 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Created reservations ['c90241ab-c279-4aba-aeb6-f1008972f11e', '30286fbd-9798-4180-90fc-60b777bc2724', '694c9a69-9af5-4006-93a6-6ba8d2c9ee28', '0b691ac3-9313-46db-8909-45383413f6d7'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Delete snapshot completed successfully. Jul 07 18:04:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-95df2ced-0921-4143-b954-8a01add84a95 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-271475de-176a-4538-99ba-5a151373ef3c-delete_snapshot" released by "delete_snapshot" :: held 3.451s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-fbd5ebdf-df23-47f8-85cd-665e350a6708-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-fbd5ebdf-df23-47f8-85cd-665e350a6708-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-fbd5ebdf-df23-47f8-85cd-665e350a6708" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-fbd5ebdf-df23-47f8-85cd-665e350a6708" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[51314443-d690-4f3f-9a1e-50b5773e5206]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:22 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 Jul 07 18:04:22 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:23 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708" returned: 0 in 0.851s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:23 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708 Jul 07 18:04:23 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:23 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:04:23 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:24 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fbd5ebdf-df23-47f8-85cd-665e350a6708" returned: 0 in 0.782s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-fbd5ebdf-df23-47f8-85cd-665e350a6708" released by "delete_volume" :: held 1.725s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Created reservations ['b52b48d4-699f-45ad-bac4-55dae0c584e9', '61464e8e-ca6e-4538-a750-c44ddba3516c', 'eccffd70-35c4-4b44-99c3-2c265f95b64b', 'a48e7308-bada-43ff-b67c-1a2b03c6b7f9'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:24 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:04:24 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:24 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.711s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:04:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:04:25 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.728s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Deleted volume successfully. Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67d3218c-9915-4c14-973d-a8e9600a7f77 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-fbd5ebdf-df23-47f8-85cd-665e350a6708-delete_volume" released by "delete_volume" :: held 2.711s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (d28203e7-0495-4153-bb9c-1dbf9b660622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9839c9f-78e2-4161-b84d-5bebaf9d1647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9839c9f-78e2-4161-b84d-5bebaf9d1647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1652472710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac09729-86c5-4549-b54a-dd8c79ed5ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e559df06c4518a2392682a09c4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:25Z,use_quota=True,user_id='0ab33de84d1d456598911c0811c23119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6ab0bf-b641-4ad9-8a8f-3ec30e2beabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6ab0bf-b641-4ad9-8a8f-3ec30e2beabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567a2d2a-bcf3-46c2-a4cd-b023a1600f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567a2d2a-bcf3-46c2-a4cd-b023a1600f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dac09729-86c5-4549-b54a-dd8c79ed5ece', 'volume_name': 'volume-dac09729-86c5-4549-b54a-dd8c79ed5ece', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67450569-6588-47be-a417-88211a962322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67450569-6588-47be-a417-88211a962322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d22063-50ea-4a83-9e3b-c0b5f5744317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:25 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Volume dac09729-86c5-4549-b54a-dd8c79ed5ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dac09729-86c5-4549-b54a-dd8c79ed5ece', 'volume_size': 1} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1652472710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dac09729-86c5-4549-b54a-dd8c79ed5ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e559df06c4518a2392682a09c4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:25Z,use_quota=True,user_id='0ab33de84d1d456598911c0811c23119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Creating volume dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:25 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:04:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:25 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece 1073741824 Jul 07 18:04:25 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:26 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece 1073741824" returned: 0 in 0.946s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:26 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece Jul 07 18:04:26 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:27 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece" returned: 0 in 0.736s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6d22063-50ea-4a83-9e3b-c0b5f5744317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dac09729-86c5-4549-b54a-dd8c79ed5ece', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fb3f24-81f6-4ac9-a318-ddcf7a6b100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:27 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Volume volume-dac09729-86c5-4549-b54a-dd8c79ed5ece (dac09729-86c5-4549-b54a-dd8c79ed5ece): created successfully Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2fb3f24-81f6-4ac9-a318-ddcf7a6b100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (d28203e7-0495-4153-bb9c-1dbf9b660622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:27 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c551360a-455f-4ed4-a7b8-3edc266b0e65 tempest-VolumesSnapshotTestJSON-430285352 None] Created volume successfully. Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Creating offline snapshot 119d6ea2-907b-461b-ac26-ef2654b97a40 of volume dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfba5738-cc02-4571-940a-2a76efa9278a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:27 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece Jul 07 18:04:27 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:28 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece" returned: 0 in 0.793s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:28 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 1G Jul 07 18:04:28 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:29 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 1G" returned: 0 in 0.935s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac09729-86c5-4549-b54a-dd8c79ed5ece -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:29 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac09729-86c5-4549-b54a-dd8c79ed5ece -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 Jul 07 18:04:29 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:30 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dac09729-86c5-4549-b54a-dd8c79ed5ece -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40" returned: 0 in 0.826s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:30 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 is being set with open permissions: ugo+rw Jul 07 18:04:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:30 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 Jul 07 18:04:30 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:30 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40" returned: 0 in 0.740s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:31 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.info Jul 07 18:04:31 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:32 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.info" returned: 0 in 0.722s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:32 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.info is being set with open permissions: ugo+rw Jul 07 18:04:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:32 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.info Jul 07 18:04:32 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:33 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.info" returned: 0 in 0.626s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.481s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:35 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f72e6ae2-f16e-4d6d-8e3c-352408406314 tempest-VolumesSnapshotTestJSON-430285352 None] Create snapshot completed successfully Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (e814d5b3-ed06-4606-a98b-8a340b6837aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9395923-d49b-4afe-808e-22bcf7692124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9395923-d49b-4afe-808e-22bcf7692124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1810913015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c444029-3d9f-4c1c-affb-c0771c3956c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e559df06c4518a2392682a09c4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=119d6ea2-907b-461b-ac26-ef2654b97a40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:36Z,use_quota=True,user_id='0ab33de84d1d456598911c0811c23119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a904cdff-25b5-40ea-8f93-8ced6ac2fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a904cdff-25b5-40ea-8f93-8ced6ac2fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b41388e-9575-4f26-9a17-5ba408f01c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b41388e-9575-4f26-9a17-5ba408f01c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9c444029-3d9f-4c1c-affb-c0771c3956c7', 'volume_name': 'volume-9c444029-3d9f-4c1c-affb-c0771c3956c7', 'volume_size': 1, 'snapshot_id': '119d6ea2-907b-461b-ac26-ef2654b97a40'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69ad60b-80dd-4f94-b8e9-dacd4af0addd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69ad60b-80dd-4f94-b8e9-dacd4af0addd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419f1151-99ee-4ada-97c6-8835c39a96ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:36 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Volume 9c444029-3d9f-4c1c-affb-c0771c3956c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9c444029-3d9f-4c1c-affb-c0771c3956c7', 'volume_size': 1, 'snapshot_id': '119d6ea2-907b-461b-ac26-ef2654b97a40'} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-119d6ea2-907b-461b-ac26-ef2654b97a40-9c444029-3d9f-4c1c-affb-c0771c3956c7" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-119d6ea2-907b-461b-ac26-ef2654b97a40-9c444029-3d9f-4c1c-affb-c0771c3956c7" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Creating volume 9c444029-3d9f-4c1c-affb-c0771c3956c7 from snapshot 119d6ea2-907b-461b-ac26-ef2654b97a40 {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-9c444029-3d9f-4c1c-affb-c0771c3956c7" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-9c444029-3d9f-4c1c-affb-c0771c3956c7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] snapshot: 119d6ea2-907b-461b-ac26-ef2654b97a40, volume: 9c444029-3d9f-4c1c-affb-c0771c3956c7, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[471b0984-ea62-43f2-bb92-5bd804b8fb05]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:36 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 Jul 07 18:04:36 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:37 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40" returned: 0 in 0.912s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dac09729-86c5-4549-b54a-dd8c79ed5ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:04:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:04:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:04:37 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3863dcd3-f3eb-4b93-bdf7-2e6e5f499184]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:37 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece Jul 07 18:04:37 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:38 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece" returned: 0 in 0.860s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:38 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:04:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:38 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 Jul 07 18:04:38 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:44 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7" returned: 0 in 5.589s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:44 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8e410-328b-433c-8575-ca824297435f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:44 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece Jul 07 18:04:44 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:45 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece" returned: 0 in 1.006s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:04:45 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Converted 1024.00 MB image at 183.18 MB/s Jul 07 18:04:45 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 is being set with open permissions: ugo+rw Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:45 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 Jul 07 18:04:45 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:45 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7" returned: 0 in 0.652s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-9c444029-3d9f-4c1c-affb-c0771c3956c7" released by "_copy_volume_from_snapshot" :: held 9.130s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-119d6ea2-907b-461b-ac26-ef2654b97a40-9c444029-3d9f-4c1c-affb-c0771c3956c7" released by "_create_volume_from_snapshot" :: held 9.176s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.207s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=76,cinder:UPDATE=72,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=68,cinder:UPDATE=67,cinder:DELETE=4,cinder:INSERT=18 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419f1151-99ee-4ada-97c6-8835c39a96ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c444029-3d9f-4c1c-affb-c0771c3956c7', 'volume_size': 1, 'snapshot_id': '119d6ea2-907b-461b-ac26-ef2654b97a40'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbfaa19-9c3d-4147-92aa-c85a5019b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:45 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Volume volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 (9c444029-3d9f-4c1c-affb-c0771c3956c7): created successfully Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbfaa19-9c3d-4147-92aa-c85a5019b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Flow 'volume_create_manager' (e814d5b3-ed06-4606-a98b-8a340b6837aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-65d4a5bc-1063-43a5-afa2-ae6bfedab2d6 tempest-VolumesSnapshotTestJSON-430285352 None] Created volume successfully. Jul 07 18:04:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-9c444029-3d9f-4c1c-affb-c0771c3956c7-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-9c444029-3d9f-4c1c-affb-c0771c3956c7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-9c444029-3d9f-4c1c-affb-c0771c3956c7" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-9c444029-3d9f-4c1c-affb-c0771c3956c7" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f7b351-369c-483f-a0cb-ef1f31c84838]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:46 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 Jul 07 18:04:46 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:47 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7" returned: 0 in 0.825s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:47 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7 Jul 07 18:04:47 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:48 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9c444029-3d9f-4c1c-affb-c0771c3956c7" returned: 0 in 0.681s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-9c444029-3d9f-4c1c-affb-c0771c3956c7" released by "delete_volume" :: held 1.559s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Created reservations ['2f535c56-bba8-46d4-8150-1a68af1d5df7', '804771da-c779-406c-a9f6-95e3f93e312a', '3c2c12be-cc96-4ee7-a94c-eaa9cefb0fdc', '8ae73ee4-f57a-4cd9-88a5-fc48b184f9f4'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:48 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:04:48 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-119d6ea2-907b-461b-ac26-ef2654b97a40-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-119d6ea2-907b-461b-ac26-ef2654b97a40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-dac09729-86c5-4549-b54a-dd8c79ed5ece" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-dac09729-86c5-4549-b54a-dd8c79ed5ece" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-119d6ea2-907b-461b-ac26-ef2654b97a40" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-119d6ea2-907b-461b-ac26-ef2654b97a40" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Deleting offline snapshot 119d6ea2-907b-461b-ac26-ef2654b97a40 of volume dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:04:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] snapshot_file for this snap is: volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1c4fcd-9977-474e-ac25-20aea69ec6f1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:49 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.729s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Deleted volume successfully. Jul 07 18:04:49 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 Jul 07 18:04:49 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a991ffde-0806-43fc-babd-5046e5bd1c9f tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-9c444029-3d9f-4c1c-affb-c0771c3956c7-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:49 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40" returned: 0 in 0.851s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dac09729-86c5-4549-b54a-dd8c79ed5ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d250b-c904-46ca-a22f-6087232115d2]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:49 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece Jul 07 18:04:49 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:50 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece" returned: 0 in 0.769s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:50 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 Jul 07 18:04:50 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:51 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40" returned: 0 in 0.731s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:51 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40 Jul 07 18:04:51 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:52 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece.119d6ea2-907b-461b-ac26-ef2654b97a40" returned: 0 in 0.636s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-119d6ea2-907b-461b-ac26-ef2654b97a40" released by "_delete_snapshot" :: held 3.101s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-dac09729-86c5-4549-b54a-dd8c79ed5ece" released by "delete_snapshot" :: held 3.131s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:52 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Created reservations ['c4c1c375-35f7-4de2-ab61-166154ae852b', 'f0a1ed25-514d-4a0d-98f8-0cfd44e1fa11', '15f899ea-cf57-477f-a7ff-cc1fc754db71', 'fc95f9a5-bdb3-4122-8398-ab9d6639e7df'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:52 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Delete snapshot completed successfully. Jul 07 18:04:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f4b55f-6137-4521-968e-86b4b423a5f5 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-119d6ea2-907b-461b-ac26-ef2654b97a40-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-dac09729-86c5-4549-b54a-dd8c79ed5ece-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-dac09729-86c5-4549-b54a-dd8c79ed5ece-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-dac09729-86c5-4549-b54a-dd8c79ed5ece" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-dac09729-86c5-4549-b54a-dd8c79ed5ece" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc47dabb-bc57-4c3e-af66-0fa8370e3857]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:53 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece Jul 07 18:04:53 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:54 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece" returned: 0 in 0.902s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:54 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece Jul 07 18:04:54 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:54 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dac09729-86c5-4549-b54a-dd8c79ed5ece" returned: 0 in 0.716s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-dac09729-86c5-4549-b54a-dd8c79ed5ece" released by "delete_volume" :: held 1.692s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Created reservations ['e091aaca-781e-45d1-835c-fd23db4feb30', 'd525e8c6-ae3e-4381-bd5a-bb40c13a74a5', '591e8d54-f988-4f39-9ab4-acd34d9c7144', 'cfd6c4ad-97b7-455a-a451-004ff08fc611'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:55 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:04:55 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-902b0152-978c-4a96-bbda-3528fe07d21f-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-902b0152-978c-4a96-bbda-3528fe07d21f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "cinder-quobyte-902b0152-978c-4a96-bbda-3528fe07d21f" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-902b0152-978c-4a96-bbda-3528fe07d21f" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a026e31-b1e1-4a49-89d4-b2b509389d72]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:55 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.737s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Deleted volume successfully. Jul 07 18:04:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9b1761ac-15f5-4c3c-a820-1cc27296b2ee tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-dac09729-86c5-4549-b54a-dd8c79ed5ece-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:55 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f Jul 07 18:04:55 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:56 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f" returned: 0 in 0.873s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:56 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f Jul 07 18:04:56 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:57 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-902b0152-978c-4a96-bbda-3528fe07d21f" returned: 0 in 0.675s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-quobyte-902b0152-978c-4a96-bbda-3528fe07d21f" released by "delete_volume" :: held 1.633s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Created reservations ['b402d500-8cd5-46fc-9019-57dd12b8f9cb', 'a19701e0-28f8-4480-899f-41ef8af2821d', 'd7d665ac-f551-4113-86e8-20365b79d2a1', '4b067424-3f9b-4616-ba58-96c3f117a2e4'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:57 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:04:57 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:58 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.686s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:58 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Deleted volume successfully. Jul 07 18:04:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00f1a5f4-bc5e-42bf-bc3f-d84a890338b2 tempest-VolumesSnapshotTestJSON-430285352 None] Lock "cinder-902b0152-978c-4a96-bbda-3528fe07d21f-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:07 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=28,cinder:SELECT=18,cinder:INSERT=11 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:05:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=33,cinder:DELETE=4,cinder:SELECT=23,cinder:INSERT=5 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Flow 'volume_create_manager' (a9b1298a-a8c8-42f6-ad34-ef9482d9cd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7622cc74-3e2a-4a7e-8ef7-7b6924cc4ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7622cc74-3e2a-4a7e-8ef7-7b6924cc4ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-233145167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8adbd0-b124-42b0-9c0a-a687eebb1e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079d0914fbba41c391305b6c32b296ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:19Z,use_quota=True,user_id='f94b41d2777e4d5e9c4d9cbd06b0098c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a879cabf-b3ec-489e-b379-3d91adcce971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a879cabf-b3ec-489e-b379-3d91adcce971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0124f20e-f313-4988-ac04-fc9f6e19e998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0124f20e-f313-4988-ac04-fc9f6e19e998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8adbd0-b124-42b0-9c0a-a687eebb1e36', 'volume_name': 'volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822387a5-e3b0-4662-82b6-375a1b0c4cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (822387a5-e3b0-4662-82b6-375a1b0c4cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00fdc42-5d45-46ed-9eb7-5ee5618f9da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Volume 3e8adbd0-b124-42b0-9c0a-a687eebb1e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36', 'volume_size': 1} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-233145167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8adbd0-b124-42b0-9c0a-a687eebb1e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='079d0914fbba41c391305b6c32b296ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:19Z,use_quota=True,user_id='f94b41d2777e4d5e9c4d9cbd06b0098c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Creating volume 3e8adbd0-b124-42b0-9c0a-a687eebb1e36 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:05:18 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:05:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:18 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 1073741824 Jul 07 18:05:18 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:19 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 1073741824" returned: 0 in 0.913s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:19 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 Jul 07 18:05:19 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:20 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36" returned: 0 in 0.788s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:05:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a00fdc42-5d45-46ed-9eb7-5ee5618f9da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0243e3-89b6-4fdd-bb20-78f5f37b7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:20 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Volume volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 (3e8adbd0-b124-42b0-9c0a-a687eebb1e36): created successfully Jul 07 18:05:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0243e3-89b6-4fdd-bb20-78f5f37b7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Flow 'volume_create_manager' (a9b1298a-a8c8-42f6-ad34-ef9482d9cd60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-190fb1e2-0687-4f8f-b619-2306b9932ad3 tempest-TestMinimumBasicScenario-1075912574 None] Created volume successfully. Jul 07 18:05:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:05:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:23 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:05:23 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c183c88c-eee6-4f69-b3ef-37c225901a6b req-76b33671-63ce-4753-ad43-904bfa82a670 tempest-TestMinimumBasicScenario-1075912574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c183c88c-eee6-4f69-b3ef-37c225901a6b req-76b33671-63ce-4753-ad43-904bfa82a670 tempest-TestMinimumBasicScenario-1075912574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f37c4-6c48-4b63-8425-2cd37eb4a38f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-c183c88c-eee6-4f69-b3ef-37c225901a6b req-76b33671-63ce-4753-ad43-904bfa82a670 tempest-TestMinimumBasicScenario-1075912574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:24 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 Jul 07 18:05:24 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:24 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.799s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:05:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:05:25 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-c183c88c-eee6-4f69-b3ef-37c225901a6b req-76b33671-63ce-4753-ad43-904bfa82a670 tempest-TestMinimumBasicScenario-1075912574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36" returned: 0 in 0.944s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-c183c88c-eee6-4f69-b3ef-37c225901a6b req-76b33671-63ce-4753-ad43-904bfa82a670 tempest-TestMinimumBasicScenario-1075912574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.972s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c183c88c-eee6-4f69-b3ef-37c225901a6b req-76b33671-63ce-4753-ad43-904bfa82a670 tempest-TestMinimumBasicScenario-1075912574 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffc3d191-9493-4ae9-9f22-bbe8f3046128', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:05:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-c183c88c-eee6-4f69-b3ef-37c225901a6b req-76b33671-63ce-4753-ad43-904bfa82a670 tempest-TestMinimumBasicScenario-1075912574 None] attachment_update completed successfully. Jul 07 18:05:30 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:05:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Flow 'volume_create_manager' (cdd31c00-c401-41d5-93ea-8f35e8e9827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7330b4-2183-46ae-bf34-85eb30c62e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce7330b4-2183-46ae-bf34-85eb30c62e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1795147055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d368da10f48d486c8275f813da3cafea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:31Z,use_quota=True,user_id='466e1933f8b545269fcc26cf5eedb285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6a74ac-269c-47ea-b7df-764fcd394056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6a74ac-269c-47ea-b7df-764fcd394056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d16aa9b-d40e-46a9-83de-a42be4bb6b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:30 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:05:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d16aa9b-d40e-46a9-83de-a42be4bb6b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2af6d2b-daf4-4d32-94b0-ccfe39b6eae4', 'volume_name': 'volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c644b350-c935-49b6-b9c6-f90290a6585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c644b350-c935-49b6-b9c6-f90290a6585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecf65ae-f263-4091-8b83-25c4e5dfbfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:31 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Volume d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 18:05:31 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Trying to clone d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 from image e34b77ca-f38c-49a7-885f-cd463a6fcc7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 18:05:31 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:05:31 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Image download 20.69 MB at 20.69 MB/s Jul 07 18:05:31 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e240e99-a022-4351-ad61-574f05a08ab8]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:31 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD Jul 07 18:05:31 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:32 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:32 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Temporary image e34b77ca-f38c-49a7-885f-cd463a6fcc7d is fetched for user 466e1933f8b545269fcc26cf5eedb285. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:05:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[05567eeb-2533-433e-9b6e-c25893d00dc3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:32 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD Jul 07 18:05:32 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:33 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD" returned: 0 in 0.858s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1795147055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d368da10f48d486c8275f813da3cafea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:31Z,use_quota=True,user_id='466e1933f8b545269fcc26cf5eedb285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Creating volume d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:05:33 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:05:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:33 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 1073741824 Jul 07 18:05:33 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:34 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 1073741824" returned: 0 in 1.024s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:34 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:05:34 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:35 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 0 in 0.718s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:05:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:35 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Attempting download of e34b77ca-f38c-49a7-885f-cd463a6fcc7d ((None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}])) to volume d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:05:35 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca229c6d-cc73-4966-9549-39e7e3a4a30e]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ztlwnq8n {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:35 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ztlwnq8n Jul 07 18:05:35 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:36 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ztlwnq8n" returned: 0 in 0.819s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ztlwnq8n {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:36 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ztlwnq8n Jul 07 18:05:36 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:36 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ztlwnq8n" returned: 1 in 0.882s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_ztlwnq8n' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:05:36 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e4339e-0d12-4893-ac01-bba63114c041]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:37 devstack sudo[102431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD Jul 07 18:05:37 devstack sudo[102431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:37 devstack sudo[102431]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:37 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] e34b77ca-f38c-49a7-885f-cd463a6fcc7d was qcow2, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:05:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:37 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:05:37 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:39 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 0 in 1.917s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:39 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e34b77ca-f38c-49a7-885f-cd463a6fcc7d_jq1ntjrndevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:05:39 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Converted 112.00 MB image at 58.36 MB/s Jul 07 18:05:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:39 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 1G Jul 07 18:05:39 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:40 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 1G" returned: 0 in 0.683s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:40 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d4053e-f711-4cf4-80d5-9f4bbe58bcec]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:40 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:05:40 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:41 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 0 in 0.780s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:41 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:05:41 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:41 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 1 in 0.781s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Downloaded image e34b77ca-f38c-49a7-885f-cd463a6fcc7d ((None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}])) to volume d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Temporary image e34b77ca-f38c-49a7-885f-cd463a6fcc7d for user 466e1933f8b545269fcc26cf5eedb285 is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Marking volume d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Copying metadata from image e34b77ca-f38c-49a7-885f-cd463a6fcc7d to d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:05:41 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Creating volume glance metadata for volume d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 backed by image e34b77ca-f38c-49a7-885f-cd463a6fcc7d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:05:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecf65ae-f263-4091-8b83-25c4e5dfbfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4', 'volume_size': 1, 'image_id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f8d739a2bbfa4d769bffef1ccd3aee95', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e34b77ca-f38c-49a7-885f-cd463a6fcc7d', 'created_at': datetime.datetime(2026, 7, 7, 15, 42, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 42, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e34b77ca-f38c-49a7-885f-cd463a6fcc7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedf1f47-d2d5-4f38-80a2-6801903d86f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:42 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Volume volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 (d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4): created successfully Jul 07 18:05:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedf1f47-d2d5-4f38-80a2-6801903d86f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:42 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Flow 'volume_create_manager' (cdd31c00-c401-41d5-93ea-8f35e8e9827c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f8107cc9-6aa0-4f20-89d6-18dc2650455d tempest-TestShelveInstance-665069794 None] Created volume successfully. Jul 07 18:05:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6854392-e43b-4b74-9fad-70f2954290d3]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:49 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:05:49 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:50 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 0 in 0.835s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:50 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:05:50 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:51 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 1 in 0.788s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:05:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.675s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4de0f8a6-d84e-4c36-9d47-13cf0d511ca3', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:05:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-4d45590f-baa1-41d7-838c-d5fa2856b413 req-5f496076-9cf9-437e-b878-7f9236d56759 tempest-TestShelveInstance-665069794 None] attachment_update completed successfully. Jul 07 18:06:01 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=11,cinder:INSERT=7,cinder:SELECT=20,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:06:01 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=26,cinder:UPDATE=11,cinder:DELETE=1,cinder:INSERT=8 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:06:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-b34acfc6-1982-4342-b07d-f9484e9a8d73 req-383b599e-f6f1-42d5-8c48-6a7c46a984d4 tempest-TestMinimumBasicScenario-1075912574 None] Terminate volume connection completed successfully. Jul 07 18:06:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-b34acfc6-1982-4342-b07d-f9484e9a8d73 req-383b599e-f6f1-42d5-8c48-6a7c46a984d4 tempest-TestMinimumBasicScenario-1075912574 None] Deleting attachment ffc3d191-9493-4ae9-9f22-bbe8f3046128. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:06:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Acquiring lock "cinder-3e8adbd0-b124-42b0-9c0a-a687eebb1e36-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Lock "cinder-3e8adbd0-b124-42b0-9c0a-a687eebb1e36-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Acquiring lock "cinder-quobyte-3e8adbd0-b124-42b0-9c0a-a687eebb1e36" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Lock "cinder-quobyte-3e8adbd0-b124-42b0-9c0a-a687eebb1e36" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:10 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b79425-2e78-436f-a5d1-75a541c23fea]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:11 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 Jul 07 18:06:11 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:11 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36" returned: 0 in 0.839s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:11 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36 Jul 07 18:06:11 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:12 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3e8adbd0-b124-42b0-9c0a-a687eebb1e36" returned: 0 in 0.641s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Lock "cinder-quobyte-3e8adbd0-b124-42b0-9c0a-a687eebb1e36" released by "delete_volume" :: held 1.535s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Created reservations ['84bf2bd1-0a2b-4b2a-be88-120d938a6923', 'b499d3b3-9bb2-4179-92b8-ad93a35f4aba', '6d6bf6c8-b737-49b0-9b57-8f6ea191ee74', '6fe0376e-5288-4f42-99e3-c8ba1a70487c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:12 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:06:12 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:13 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.635s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:13 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:13 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Deleted volume successfully. Jul 07 18:06:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e0563142-68c8-4bcf-b402-40ac4b659008 tempest-TestMinimumBasicScenario-1075912574 None] Lock "cinder-3e8adbd0-b124-42b0-9c0a-a687eebb1e36-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:22 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:06:23 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:06:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:06:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:23 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:06:23 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:24 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.705s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:06:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:06:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:06:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-2597f594-6918-42a4-92c1-22b80824384b req-09cab878-9325-4e3a-bd00-d22496be7a5b tempest-TestShelveInstance-665069794 None] Terminate volume connection completed successfully. Jul 07 18:06:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-2597f594-6918-42a4-92c1-22b80824384b req-09cab878-9325-4e3a-bd00-d22496be7a5b tempest-TestShelveInstance-665069794 None] Deleting attachment 4de0f8a6-d84e-4c36-9d47-13cf0d511ca3. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:06:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:34 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb86cc-963e-4f40-aabb-12599da02936]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:34 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:06:34 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:35 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 0 in 0.789s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:35 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:06:35 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:36 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 1 in 0.902s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:06:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.761s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a5518ac-5714-4ed8-b8a7-0afdb7e9d47b', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:06:36 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-7468a6b0-f6d2-42cc-aa3f-1681060e23d2 req-ddbbbe8b-ebb6-4c15-b02a-0b4da1e7b9a1 tempest-TestShelveInstance-665069794 None] attachment_update completed successfully. Jul 07 18:06:46 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:06:46 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:07:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:07:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:23 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:07:23 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:24 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.648s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:07:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:07:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:07:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:07:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-250c5140-595d-4277-8f7e-75e50fb291b9 tempest-TestShelveInstance-665069794 None] Terminate volume connection completed successfully. Jul 07 18:07:30 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-250c5140-595d-4277-8f7e-75e50fb291b9 tempest-TestShelveInstance-665069794 None] Deleting attachment 5a5518ac-5714-4ed8-b8a7-0afdb7e9d47b. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Acquiring lock "cinder-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Lock "cinder-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Acquiring lock "cinder-quobyte-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Lock "cinder-quobyte-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1e7b0b-1968-4f93-88be-d51a2961afce]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Flow 'volume_create_manager' (b2645022-460a-4e73-8c33-1d517b4fef6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be9c45-a394-411d-aecd-002af4e604cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be9c45-a394-411d-aecd-002af4e604cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-600948232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7115ba6-1f83-4588-bd43-b734b7de1eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9704022798574fd3b61a8d2ebdbd3dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:32Z,use_quota=True,user_id='cf7f4c903c374751ac7e92b5fa1daa69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a625e29f-b0ef-4590-8368-0fe36a4a412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:31 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:07:31 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a625e29f-b0ef-4590-8368-0fe36a4a412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731bf4b6-e07d-4879-88eb-eb8ad683cdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731bf4b6-e07d-4879-88eb-eb8ad683cdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7115ba6-1f83-4588-bd43-b734b7de1eae', 'volume_name': 'volume-d7115ba6-1f83-4588-bd43-b734b7de1eae', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e75905-09b9-440f-a37c-aa04a0714faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e75905-09b9-440f-a37c-aa04a0714faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939d60b8-095d-460b-b72a-1d1022322d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:31 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Volume d7115ba6-1f83-4588-bd43-b734b7de1eae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7115ba6-1f83-4588-bd43-b734b7de1eae', 'volume_size': 1} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-600948232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7115ba6-1f83-4588-bd43-b734b7de1eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9704022798574fd3b61a8d2ebdbd3dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:32Z,use_quota=True,user_id='cf7f4c903c374751ac7e92b5fa1daa69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Creating volume d7115ba6-1f83-4588-bd43-b734b7de1eae {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:31 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:07:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:31 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae 1073741824 Jul 07 18:07:31 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:32 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 0 in 0.849s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:32 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:07:32 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:32 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae 1073741824" returned: 0 in 0.945s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:32 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae Jul 07 18:07:32 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:33 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 1 in 0.876s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:33 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4 Jul 07 18:07:33 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:33 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae" returned: 0 in 0.725s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (939d60b8-095d-460b-b72a-1d1022322d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7115ba6-1f83-4588-bd43-b734b7de1eae', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8ad572-f3ef-42eb-b2d1-3578f669bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:33 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Volume volume-d7115ba6-1f83-4588-bd43-b734b7de1eae (d7115ba6-1f83-4588-bd43-b734b7de1eae): created successfully Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8ad572-f3ef-42eb-b2d1-3578f669bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Flow 'volume_create_manager' (b2645022-460a-4e73-8c33-1d517b4fef6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8c0a6c51-3d06-4b41-924e-182046723821 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Created volume successfully. Jul 07 18:07:34 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" returned: 0 in 0.680s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Lock "cinder-quobyte-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4" released by "delete_volume" :: held 2.481s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG cinder.quota [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Created reservations ['d4f5d5a3-7b31-41fa-acb6-ecca50945506', 'd2ca2c76-0045-430f-9eee-fead33c486d2', 'b52bf597-a98f-4f51-b710-2221bc95142b', 'ce8c7cca-caf4-44d5-bed6-268949028ff4'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:34 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:07:34 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:34 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.719s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG cinder.manager [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:07:34 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Deleted volume successfully. Jul 07 18:07:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [req-7714471b-ccbb-4199-b4c5-3aee3f6660e1 req-11d9dfad-8741-4b91-ad4d-e888b1cac760 tempest-TestShelveInstance-665069794 None] Lock "cinder-d2af6d2b-daf4-4d32-94b0-ccfe39b6eae4-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-61cb881c-be5a-451f-93c1-f2a5c730a6be req-e0a2060d-4509-483f-b8c8-2d6e99ee8b3d tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-61cb881c-be5a-451f-93c1-f2a5c730a6be req-e0a2060d-4509-483f-b8c8-2d6e99ee8b3d tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:36 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e93dec-b185-4a63-98ea-cacc8785bd92]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-61cb881c-be5a-451f-93c1-f2a5c730a6be req-e0a2060d-4509-483f-b8c8-2d6e99ee8b3d tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:36 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae Jul 07 18:07:36 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:37 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-61cb881c-be5a-451f-93c1-f2a5c730a6be req-e0a2060d-4509-483f-b8c8-2d6e99ee8b3d tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae" returned: 0 in 0.825s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-61cb881c-be5a-451f-93c1-f2a5c730a6be req-e0a2060d-4509-483f-b8c8-2d6e99ee8b3d tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.847s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-61cb881c-be5a-451f-93c1-f2a5c730a6be req-e0a2060d-4509-483f-b8c8-2d6e99ee8b3d tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-d7115ba6-1f83-4588-bd43-b734b7de1eae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b08ca3a-c2ab-41e1-95b4-c465c746f95b', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:07:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-61cb881c-be5a-451f-93c1-f2a5c730a6be req-e0a2060d-4509-483f-b8c8-2d6e99ee8b3d tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] attachment_update completed successfully. Jul 07 18:07:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-6b5e9482-b8b5-40d2-9bed-0f8c79b5fd83 req-5c1f29fb-af4f-4033-8515-c287df6a45ef tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Terminate volume connection completed successfully. Jul 07 18:07:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-6b5e9482-b8b5-40d2-9bed-0f8c79b5fd83 req-5c1f29fb-af4f-4033-8515-c287df6a45ef tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Deleting attachment 4b08ca3a-c2ab-41e1-95b4-c465c746f95b. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:07:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Acquiring lock "cinder-d7115ba6-1f83-4588-bd43-b734b7de1eae-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "cinder-d7115ba6-1f83-4588-bd43-b734b7de1eae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Acquiring lock "cinder-quobyte-d7115ba6-1f83-4588-bd43-b734b7de1eae" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "cinder-quobyte-d7115ba6-1f83-4588-bd43-b734b7de1eae" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:47 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[359a4dc0-b0c2-4f98-9937-efcd7c8d55da]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:47 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae Jul 07 18:07:47 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:47 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae" returned: 0 in 0.903s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:47 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae Jul 07 18:07:47 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (6c82c6b0-5165-4cb3-9e57-821263ab8044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a47641-fb1d-401e-bd57-ed061d28f0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a47641-fb1d-401e-bd57-ed061d28f0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104487417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b57440-4e5c-4d0d-a3b7-3adf9217d054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:48Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed61b87-6226-4194-b96f-baf84a743527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed61b87-6226-4194-b96f-baf84a743527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdb6a04-622d-437e-bb23-e1be0967cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bdb6a04-622d-437e-bb23-e1be0967cf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b57440-4e5c-4d0d-a3b7-3adf9217d054', 'volume_name': 'volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7b354b-8364-4c6e-85b7-11f4b5882823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7b354b-8364-4c6e-85b7-11f4b5882823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1da7b5-452a-449f-9619-97ecc3e59fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:48 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume 00b57440-4e5c-4d0d-a3b7-3adf9217d054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054', 'volume_size': 1} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104487417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b57440-4e5c-4d0d-a3b7-3adf9217d054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:48Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Creating volume 00b57440-4e5c-4d0d-a3b7-3adf9217d054 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:48 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:48 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 1073741824 Jul 07 18:07:48 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:48 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d7115ba6-1f83-4588-bd43-b734b7de1eae" returned: 0 in 0.763s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "cinder-quobyte-d7115ba6-1f83-4588-bd43-b734b7de1eae" released by "delete_volume" :: held 1.713s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Created reservations ['e1f645bc-0faa-4eb1-917e-22c14324d20f', 'cf8c43f6-802b-48db-abc4-c3b25c91b4b1', 'ae17cda3-f222-45fb-a211-8db18da4ae0b', '84286e4d-4062-4d00-841f-73cc5308fc5d'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:48 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:07:48 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:49 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 1073741824" returned: 0 in 0.988s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:49 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 Jul 07 18:07:49 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:49 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.743s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:49 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:07:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Deleted volume successfully. Jul 07 18:07:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-763b48bc-b614-448d-a6ef-2848cd8982b6 tempest-TestServerVolumeAttachScenarioOldVersion-167943992 None] Lock "cinder-d7115ba6-1f83-4588-bd43-b734b7de1eae-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:50 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054" returned: 0 in 0.685s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1da7b5-452a-449f-9619-97ecc3e59fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e7b5ac-f10e-48cd-9ff2-038c02fd1c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:50 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 (00b57440-4e5c-4d0d-a3b7-3adf9217d054): created successfully Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e7b5ac-f10e-48cd-9ff2-038c02fd1c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (6c82c6b0-5165-4cb3-9e57-821263ab8044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f63de0a8-ad2e-4628-94a2-41eabc8a583b tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created volume successfully. Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (bbae9cef-1bcf-40a0-83a8-89dce61676d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8194d7-03a8-434e-b971-d0ae092d3478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a8194d7-03a8-434e-b971-d0ae092d3478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-428110224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc02fd0-468b-4328-a7e7-716b2b68aafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:51Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06c6d61-bc93-46ef-83a1-52f8d564f85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d06c6d61-bc93-46ef-83a1-52f8d564f85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b7f6c7-5a4c-4d63-9d92-dfbf117f2100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b7f6c7-5a4c-4d63-9d92-dfbf117f2100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc02fd0-468b-4328-a7e7-716b2b68aafc', 'volume_name': 'volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c784f5-e9d3-47f8-a4cb-ba227c2e3468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c784f5-e9d3-47f8-a4cb-ba227c2e3468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22666a9-27ff-412f-afc2-a28837eea6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:50 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume bbc02fd0-468b-4328-a7e7-716b2b68aafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc', 'volume_size': 1} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-428110224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc02fd0-468b-4328-a7e7-716b2b68aafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:51Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Creating volume bbc02fd0-468b-4328-a7e7-716b2b68aafc {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:50 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:07:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:50 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc 1073741824 Jul 07 18:07:50 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (4c1d58ae-9917-460a-b399-29cf55bb0b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebab55b-a7bf-488c-93ac-c0ada5b021a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebab55b-a7bf-488c-93ac-c0ada5b021a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776332591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a067cedd-1ab6-4efc-a77e-c036f9093ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:51Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57face0-3030-4b94-a4e6-ef711c669991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57face0-3030-4b94-a4e6-ef711c669991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417b55d2-7950-4dc4-9a14-89c1d84e3c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417b55d2-7950-4dc4-9a14-89c1d84e3c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a067cedd-1ab6-4efc-a77e-c036f9093ffc', 'volume_name': 'volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2deed73c-92d2-4066-b87c-1990304fca17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2deed73c-92d2-4066-b87c-1990304fca17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aabc84-9f93-47e8-894f-bd3079770911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume a067cedd-1ab6-4efc-a77e-c036f9093ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc', 'volume_size': 1} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (3e4002ff-0d88-4f6f-a5fd-f162d61fae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ee83b9-95a9-46da-bbb8-f2fa2f42136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ee83b9-95a9-46da-bbb8-f2fa2f42136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087278717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2168a6a-b1e6-48ee-ab65-e68911656a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:52Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4393566-55df-4015-9000-54a0c18c7b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4393566-55df-4015-9000-54a0c18c7b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1badc90-8776-4440-ab87-926edcd93393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1badc90-8776-4440-ab87-926edcd93393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2168a6a-b1e6-48ee-ab65-e68911656a5e', 'volume_name': 'volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a2d47b-5185-4b1a-9734-a7822323e481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a2d47b-5185-4b1a-9734-a7822323e481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443aa367-8961-48da-840e-4c6c562f035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:51 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume a2168a6a-b1e6-48ee-ab65-e68911656a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e', 'volume_size': 1} Jul 07 18:07:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:52 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc 1073741824" returned: 0 in 1.177s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:52 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc Jul 07 18:07:52 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (50c3567a-3765-4237-8e45-18af07a019be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc64e00-8fc9-4f80-99eb-9419698dc1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc64e00-8fc9-4f80-99eb-9419698dc1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113697810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f619f39-380d-4b66-a113-10c82a46f752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:52Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a94426-bcff-4bfa-ba3b-02b0d8cc700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a94426-bcff-4bfa-ba3b-02b0d8cc700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e12f5ce-97fb-4dbf-aa7f-c8f6a0337e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e12f5ce-97fb-4dbf-aa7f-c8f6a0337e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f619f39-380d-4b66-a113-10c82a46f752', 'volume_name': 'volume-3f619f39-380d-4b66-a113-10c82a46f752', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2399baaa-5c65-477b-9ab1-5a57c7476309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2399baaa-5c65-477b-9ab1-5a57c7476309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc7c2ce-6d92-4ea7-83ed-d75b1ace36ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume 3f619f39-380d-4b66-a113-10c82a46f752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f619f39-380d-4b66-a113-10c82a46f752', 'volume_size': 1} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (ec2267ed-ff5d-4923-8969-dd12696a51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b32d30-27f3-421b-b5f4-b963e80a3de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b32d30-27f3-421b-b5f4-b963e80a3de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542130387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39013b68-963d-41de-bd4d-282797e65b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:53Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbc1749-15fa-40ee-bd40-4b64d75d03e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbc1749-15fa-40ee-bd40-4b64d75d03e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1314d316-9f41-40ba-bb45-e7f02d404c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1314d316-9f41-40ba-bb45-e7f02d404c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39013b68-963d-41de-bd4d-282797e65b12', 'volume_name': 'volume-39013b68-963d-41de-bd4d-282797e65b12', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe26948-0563-4f1b-863e-a7178c5376ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe26948-0563-4f1b-863e-a7178c5376ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25280f7-00a6-4b41-b61e-3807976130af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:52 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume 39013b68-963d-41de-bd4d-282797e65b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39013b68-963d-41de-bd4d-282797e65b12', 'volume_size': 1} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:52 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc" returned: 0 in 0.856s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776332591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a067cedd-1ab6-4efc-a77e-c036f9093ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:51Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Creating volume a067cedd-1ab6-4efc-a77e-c036f9093ffc {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:53 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22666a9-27ff-412f-afc2-a28837eea6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:53 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc 1073741824 Jul 07 18:07:53 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dd6596-2ca6-472e-b9f9-8a4f873ead4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:53 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc (bbc02fd0-468b-4328-a7e7-716b2b68aafc): created successfully Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dd6596-2ca6-472e-b9f9-8a4f873ead4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (bbae9cef-1bcf-40a0-83a8-89dce61676d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:53 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bf04e894-c499-4e79-89cd-6d1b30daacb5 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created volume successfully. Jul 07 18:07:53 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc 1073741824" returned: 0 in 0.906s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:53 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc Jul 07 18:07:53 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:54 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc" returned: 0 in 0.684s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.699s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1087278717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2168a6a-b1e6-48ee-ab65-e68911656a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:52Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Creating volume a2168a6a-b1e6-48ee-ab65-e68911656a5e {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:54 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:54 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e 1073741824 Jul 07 18:07:54 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aabc84-9f93-47e8-894f-bd3079770911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc446646-dd09-484f-8efb-a47dc6e7fdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:54 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc (a067cedd-1ab6-4efc-a77e-c036f9093ffc): created successfully Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc446646-dd09-484f-8efb-a47dc6e7fdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (4c1d58ae-9917-460a-b399-29cf55bb0b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1e12021d-8855-4796-8bdc-c7c492521fe6 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created volume successfully. Jul 07 18:07:55 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e 1073741824" returned: 0 in 0.876s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:55 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e Jul 07 18:07:55 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:56 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e" returned: 0 in 0.705s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.834s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113697810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f619f39-380d-4b66-a113-10c82a46f752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:52Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Creating volume 3f619f39-380d-4b66-a113-10c82a46f752 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:56 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443aa367-8961-48da-840e-4c6c562f035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac28896c-4404-48bf-9888-25ea75070c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:56 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 1073741824 Jul 07 18:07:56 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:56 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e (a2168a6a-b1e6-48ee-ab65-e68911656a5e): created successfully Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac28896c-4404-48bf-9888-25ea75070c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (3e4002ff-0d88-4f6f-a5fd-f162d61fae21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f762ca74-53d5-4650-86d2-69fbd7db7055 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created volume successfully. Jul 07 18:07:57 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 1073741824" returned: 0 in 1.017s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:57 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 Jul 07 18:07:57 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:58 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752" returned: 0 in 0.686s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.117s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-542130387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39013b68-963d-41de-bd4d-282797e65b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421e36dce2714da4a62722b2495d9fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:53Z,use_quota=True,user_id='d432377381a84ae9ac55e12be4e2498a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Creating volume 39013b68-963d-41de-bd4d-282797e65b12 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:58 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc7c2ce-6d92-4ea7-83ed-d75b1ace36ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f619f39-380d-4b66-a113-10c82a46f752', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:58 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 1073741824 Jul 07 18:07:58 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9564bd0f-9f84-4c8d-b4ce-a2cecabf8c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:58 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume volume-3f619f39-380d-4b66-a113-10c82a46f752 (3f619f39-380d-4b66-a113-10c82a46f752): created successfully Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9564bd0f-9f84-4c8d-b4ce-a2cecabf8c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (50c3567a-3765-4237-8e45-18af07a019be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0b640fe7-3d55-4af8-a1f2-1cbb80b9c61e tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created volume successfully. Jul 07 18:07:59 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 1073741824" returned: 0 in 0.974s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:59 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 Jul 07 18:07:59 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:59 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12" returned: 0 in 0.698s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25280f7-00a6-4b41-b61e-3807976130af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39013b68-963d-41de-bd4d-282797e65b12', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecf20d6-099f-4a1b-a0c0-1ba46019a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:59 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Volume volume-39013b68-963d-41de-bd4d-282797e65b12 (39013b68-963d-41de-bd4d-282797e65b12): created successfully Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ecf20d6-099f-4a1b-a0c0-1ba46019a871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Flow 'volume_create_manager' (ec2267ed-ff5d-4923-8969-dd12696a51fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-abd6859c-5a21-4812-8588-d835fc75abcb tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created volume successfully. Jul 07 18:08:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-39013b68-963d-41de-bd4d-282797e65b12-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-39013b68-963d-41de-bd4d-282797e65b12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-quobyte-39013b68-963d-41de-bd4d-282797e65b12" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-39013b68-963d-41de-bd4d-282797e65b12" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8074b873-3317-4198-9652-bb457f4b0c75]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:00 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 Jul 07 18:08:00 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:01 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12" returned: 0 in 0.868s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:01 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12 Jul 07 18:08:01 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:02 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-39013b68-963d-41de-bd4d-282797e65b12" returned: 0 in 0.708s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-39013b68-963d-41de-bd4d-282797e65b12" released by "delete_volume" :: held 1.624s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created reservations ['a88646b2-8635-4059-a99f-ec88aa57599f', '6c32170d-1d60-4804-8e2c-62e14ba2e2fb', 'b83efa66-a0d3-46a4-90b6-038737eeec2d', '963b9f1c-2d45-4d45-b968-b49f5c1c2432'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:02 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:02 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-3f619f39-380d-4b66-a113-10c82a46f752-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-3f619f39-380d-4b66-a113-10c82a46f752-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-quobyte-3f619f39-380d-4b66-a113-10c82a46f752" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-3f619f39-380d-4b66-a113-10c82a46f752" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:03 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3f4e25-a41d-42fb-b332-16b226dab679]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:03 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 Jul 07 18:08:03 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:03 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.765s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:03 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Deleted volume successfully. Jul 07 18:08:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-7fe85919-90a0-4fd1-8d7e-a75876b5f4b0 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-39013b68-963d-41de-bd4d-282797e65b12-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:04 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752" returned: 0 in 0.921s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:04 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752 Jul 07 18:08:04 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:04 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3f619f39-380d-4b66-a113-10c82a46f752" returned: 0 in 0.677s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-3f619f39-380d-4b66-a113-10c82a46f752" released by "delete_volume" :: held 1.655s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created reservations ['f7edf97c-3669-4639-97b9-22f29a0929b0', '4b2e32a1-1b2c-4ed5-b485-314b3032c666', 'cccc742b-3f83-4bdc-ae8b-6f562d0c6c0c', '5ea828b5-a590-477f-bcc2-9454716cdc25'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:04 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:04 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-a2168a6a-b1e6-48ee-ab65-e68911656a5e-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-a2168a6a-b1e6-48ee-ab65-e68911656a5e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-quobyte-a2168a6a-b1e6-48ee-ab65-e68911656a5e" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-a2168a6a-b1e6-48ee-ab65-e68911656a5e" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9b82fb-f9da-4be3-bbd0-83fdc2fd8d83]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:05 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e Jul 07 18:08:05 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:05 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.887s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:05 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Deleted volume successfully. Jul 07 18:08:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-93c5fc3a-279a-4611-aeb3-b31b808bbe24 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-3f619f39-380d-4b66-a113-10c82a46f752-delete_volume" released by "delete_volume" :: held 2.771s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:06 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e" returned: 0 in 1.165s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:06 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e Jul 07 18:08:06 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:07 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a2168a6a-b1e6-48ee-ab65-e68911656a5e" returned: 0 in 0.661s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-a2168a6a-b1e6-48ee-ab65-e68911656a5e" released by "delete_volume" :: held 1.919s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created reservations ['23f88725-8837-499a-ab15-1788b513fe21', '69733cb6-044f-4107-b9f7-bd926ea132e0', '3c5e5642-e90f-4ba6-bb11-39643d38db6f', 'f38af98f-43d3-4a71-bae3-9faf6569b87e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:07 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:07 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-a067cedd-1ab6-4efc-a77e-c036f9093ffc-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-a067cedd-1ab6-4efc-a77e-c036f9093ffc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-quobyte-a067cedd-1ab6-4efc-a77e-c036f9093ffc" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-a067cedd-1ab6-4efc-a77e-c036f9093ffc" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc5d7e-e048-4800-931e-1f7f6aea4b8e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:07 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc Jul 07 18:08:07 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:08 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.794s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:08 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Deleted volume successfully. Jul 07 18:08:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0fa28fd6-f29b-4239-9e08-119bcfac41ff tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-a2168a6a-b1e6-48ee-ab65-e68911656a5e-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:08 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc" returned: 0 in 0.898s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:08 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc Jul 07 18:08:08 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:09 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a067cedd-1ab6-4efc-a77e-c036f9093ffc" returned: 0 in 0.690s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-a067cedd-1ab6-4efc-a77e-c036f9093ffc" released by "delete_volume" :: held 1.632s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created reservations ['95ac04b5-3aa8-410b-9f74-c614c268f26e', '295bbc2c-29bb-4b49-afb2-49bc793f3588', '8b86a3a7-2dc5-48b0-a7c9-5c9fc41c6603', '9a6022ff-2766-4880-8228-71c06d420a81'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:09 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:09 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-bbc02fd0-468b-4328-a7e7-716b2b68aafc-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-bbc02fd0-468b-4328-a7e7-716b2b68aafc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-quobyte-bbc02fd0-468b-4328-a7e7-716b2b68aafc" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-bbc02fd0-468b-4328-a7e7-716b2b68aafc" acquired by "delete_volume" :: waited 0.030s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:10 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5610690d-1927-4d73-a5b7-79bfde0cf697]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:10 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc Jul 07 18:08:10 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:10 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.742s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:10 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Deleted volume successfully. Jul 07 18:08:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5d278cf-0bc5-484a-95f6-e57f38c6a951 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-a067cedd-1ab6-4efc-a77e-c036f9093ffc-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:10 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc" returned: 0 in 0.874s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:10 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc Jul 07 18:08:10 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:11 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bbc02fd0-468b-4328-a7e7-716b2b68aafc" returned: 0 in 0.702s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-bbc02fd0-468b-4328-a7e7-716b2b68aafc" released by "delete_volume" :: held 1.642s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created reservations ['96f4009d-40ba-4e2e-87d9-33c8c786dd1a', '9ccd5f59-09cf-44f5-9fde-9d179cb3a427', 'a5d96ef6-701e-4b61-94b4-ed7da7800ecc', 'ee290dc0-70c0-44bc-92b2-2861d3538dc2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:11 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:11 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-00b57440-4e5c-4d0d-a3b7-3adf9217d054-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-00b57440-4e5c-4d0d-a3b7-3adf9217d054-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "cinder-quobyte-00b57440-4e5c-4d0d-a3b7-3adf9217d054" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-00b57440-4e5c-4d0d-a3b7-3adf9217d054" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4b9178-e478-4991-a42a-d664b97c4365]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:12 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 Jul 07 18:08:12 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:12 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.803s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:12 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Deleted volume successfully. Jul 07 18:08:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-895790ec-b0ab-4bac-a4cc-7467995a85b8 tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-bbc02fd0-468b-4328-a7e7-716b2b68aafc-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:13 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054" returned: 0 in 0.945s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:13 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054 Jul 07 18:08:13 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:13 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-00b57440-4e5c-4d0d-a3b7-3adf9217d054" returned: 0 in 0.708s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-quobyte-00b57440-4e5c-4d0d-a3b7-3adf9217d054" released by "delete_volume" :: held 1.707s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Created reservations ['97f2adb2-a5ff-4d84-b7ee-db63fcb93127', '1710b7c1-fb54-4a69-97aa-9f45db10ab0d', '06c7b980-500d-403c-8310-eeb0aa722b63', '966c1e85-85b2-4535-8331-8bd59ee5ba20'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:14 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:14 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:14 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.812s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Deleted volume successfully. Jul 07 18:08:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-22fe6260-677c-4ecd-8c8a-63d142ebea1f tempest-CreateVolumesFromSourceVolumeTest-701407332 None] Lock "cinder-00b57440-4e5c-4d0d-a3b7-3adf9217d054-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=90,cinder:SELECT=63,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=62,cinder:UPDATE=85,cinder:INSERT=15,cinder:DELETE=8 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Flow 'volume_create_manager' (fb028195-04c9-45e5-992d-e2fb6d0ed283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c3287f-3c7b-4b44-9ca6-a6685d4cb1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c3287f-3c7b-4b44-9ca6-a6685d4cb1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-416494668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da6b534-0427-4747-ba89-20fc6f04cf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09d0e1a4c6f4145ba064434310eaf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:18Z,use_quota=True,user_id='491bd73d59c945b19ed84ac303595555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f0ca84-9588-4fda-8c2d-5250c51a6c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f0ca84-9588-4fda-8c2d-5250c51a6c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b81e555-2db6-4fa7-b75d-1299d45c07cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b81e555-2db6-4fa7-b75d-1299d45c07cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da6b534-0427-4747-ba89-20fc6f04cf1c', 'volume_name': 'volume-3da6b534-0427-4747-ba89-20fc6f04cf1c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2ec33c-e77e-4181-9e33-3907e8654fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2ec33c-e77e-4181-9e33-3907e8654fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2800ea0-386a-427a-b85e-3b1087fb3035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Volume 3da6b534-0427-4747-ba89-20fc6f04cf1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da6b534-0427-4747-ba89-20fc6f04cf1c', 'volume_size': 1} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-416494668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da6b534-0427-4747-ba89-20fc6f04cf1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09d0e1a4c6f4145ba064434310eaf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:18Z,use_quota=True,user_id='491bd73d59c945b19ed84ac303595555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Creating volume 3da6b534-0427-4747-ba89-20fc6f04cf1c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:08:18 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:08:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:18 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c 1073741824 Jul 07 18:08:18 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:19 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c 1073741824" returned: 0 in 0.946s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:19 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c Jul 07 18:08:19 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:20 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c" returned: 0 in 0.727s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2800ea0-386a-427a-b85e-3b1087fb3035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da6b534-0427-4747-ba89-20fc6f04cf1c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15eefb7-5b64-4cc5-b75b-0e2ca1e120c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:20 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Volume volume-3da6b534-0427-4747-ba89-20fc6f04cf1c (3da6b534-0427-4747-ba89-20fc6f04cf1c): created successfully Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15eefb7-5b64-4cc5-b75b-0e2ca1e120c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Flow 'volume_create_manager' (fb028195-04c9-45e5-992d-e2fb6d0ed283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0d60edb0-4c87-4e48-b3d7-c6e36ccbe8f7 tempest-ProjectReaderTests-1936819672 None] Created volume successfully. Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Acquiring lock "cinder-3da6b534-0427-4747-ba89-20fc6f04cf1c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Lock "cinder-3da6b534-0427-4747-ba89-20fc6f04cf1c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Acquiring lock "cinder-quobyte-3da6b534-0427-4747-ba89-20fc6f04cf1c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Lock "cinder-quobyte-3da6b534-0427-4747-ba89-20fc6f04cf1c" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0184f77b-d1f7-49bd-a9cd-9b077e894caa]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:21 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c Jul 07 18:08:21 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:21 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c" returned: 0 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:21 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c Jul 07 18:08:21 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:22 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-3da6b534-0427-4747-ba89-20fc6f04cf1c" returned: 0 in 0.749s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Lock "cinder-quobyte-3da6b534-0427-4747-ba89-20fc6f04cf1c" released by "delete_volume" :: held 1.672s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Created reservations ['78d4f39f-2f79-4f54-834e-9cd49aaf87ca', 'bb2bf0f8-1497-4193-abee-4627ede07fd1', 'f87fddb1-dda5-4e57-92bb-dd91f87a8620', '3dd49933-5d9b-45cc-8b2e-8b5904615ea2'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:22 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:22 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:23 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.768s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Deleted volume successfully. Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a31a6a91-a155-471a-8b51-465d372bfcd5 tempest-ProjectReaderTests-1936819672 None] Lock "cinder-3da6b534-0427-4747-ba89-20fc6f04cf1c-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Flow 'volume_create_manager' (a2b82520-d4d4-4d8d-9cae-f1cedce3491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9bbda4-fe99-4424-8f12-5bf25e305ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9bbda4-fe99-4424-8f12-5bf25e305ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303181861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409520fa-4e87-4e60-9df0-738ec4bdeeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09d0e1a4c6f4145ba064434310eaf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:24Z,use_quota=True,user_id='491bd73d59c945b19ed84ac303595555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ec4144-b15d-448e-a522-11dce2fabb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ec4144-b15d-448e-a522-11dce2fabb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53612935-8589-4e15-96ad-c7ff67ea8fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53612935-8589-4e15-96ad-c7ff67ea8fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409520fa-4e87-4e60-9df0-738ec4bdeeab', 'volume_name': 'volume-409520fa-4e87-4e60-9df0-738ec4bdeeab', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9d022b-d8cb-4800-80c5-b106e76aa764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9d022b-d8cb-4800-80c5-b106e76aa764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe81d0e0-087c-419d-9a70-ec1b9ba33701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:23 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Volume 409520fa-4e87-4e60-9df0-738ec4bdeeab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409520fa-4e87-4e60-9df0-738ec4bdeeab', 'volume_size': 1} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303181861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409520fa-4e87-4e60-9df0-738ec4bdeeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c09d0e1a4c6f4145ba064434310eaf8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:24Z,use_quota=True,user_id='491bd73d59c945b19ed84ac303595555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Creating volume 409520fa-4e87-4e60-9df0-738ec4bdeeab {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:08:23 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:23 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab 1073741824 Jul 07 18:08:23 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:23 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:23 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:24 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.691s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:08:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:08:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:08:24 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab 1073741824" returned: 0 in 0.956s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:24 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab Jul 07 18:08:24 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:25 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab" returned: 0 in 0.669s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:08:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe81d0e0-087c-419d-9a70-ec1b9ba33701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409520fa-4e87-4e60-9df0-738ec4bdeeab', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da70efbb-362d-45e9-9fa7-cfbffcb7357b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:25 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Volume volume-409520fa-4e87-4e60-9df0-738ec4bdeeab (409520fa-4e87-4e60-9df0-738ec4bdeeab): created successfully Jul 07 18:08:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da70efbb-362d-45e9-9fa7-cfbffcb7357b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Flow 'volume_create_manager' (a2b82520-d4d4-4d8d-9cae-f1cedce3491a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0d3ec23c-f049-48a0-9073-190855bad9f2 tempest-ProjectReaderTests-1936819672 None] Created volume successfully. Jul 07 18:08:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Acquiring lock "cinder-409520fa-4e87-4e60-9df0-738ec4bdeeab-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Lock "cinder-409520fa-4e87-4e60-9df0-738ec4bdeeab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Acquiring lock "cinder-quobyte-409520fa-4e87-4e60-9df0-738ec4bdeeab" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Lock "cinder-quobyte-409520fa-4e87-4e60-9df0-738ec4bdeeab" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c310799f-cb7c-4713-a5ed-5a5c09d95f25]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:26 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab Jul 07 18:08:26 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:26 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab" returned: 0 in 0.802s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:26 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab Jul 07 18:08:26 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:27 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-409520fa-4e87-4e60-9df0-738ec4bdeeab" returned: 0 in 0.846s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Lock "cinder-quobyte-409520fa-4e87-4e60-9df0-738ec4bdeeab" released by "delete_volume" :: held 1.707s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Created reservations ['78edb9c8-5e77-455c-a1c4-877883a7468a', 'e9053baf-3aa0-443d-860f-165ed9e63f94', '6bc5e5e7-e272-4d1a-9e07-75a66149e4fe', '9ed0946e-2ad6-4674-922d-bea22f6c1b7f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:27 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:08:27 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:28 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.811s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:28 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Deleted volume successfully. Jul 07 18:08:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d5c0c63d-a535-4e16-b521-4b5d22a0700a tempest-ProjectReaderTests-1936819672 None] Lock "cinder-409520fa-4e87-4e60-9df0-738ec4bdeeab-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Flow 'volume_create_manager' (51933f37-fc5f-403d-a883-53fc0505e627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bb9d19-bd92-4607-8ef7-9e1fcbf5e439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4bb9d19-bd92-4607-8ef7-9e1fcbf5e439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1348638076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac48051-f5d4-4f4f-bada-602243618565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d20cd367d284cbe8c3bb33e027eea3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:32Z,use_quota=True,user_id='ad148b9e5c5e4386a98ff06f3cbe23aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d137d0-b1a7-4b0b-8269-41e449aa410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05d137d0-b1a7-4b0b-8269-41e449aa410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c4f933-3074-4b5e-8aac-282aade99a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c4f933-3074-4b5e-8aac-282aade99a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ac48051-f5d4-4f4f-bada-602243618565', 'volume_name': 'volume-6ac48051-f5d4-4f4f-bada-602243618565', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541f3eee-0ed7-48ec-80a0-3bb7faa017b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541f3eee-0ed7-48ec-80a0-3bb7faa017b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909378a2-d419-4d5e-83fa-f5bfcfa0537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Volume 6ac48051-f5d4-4f4f-bada-602243618565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ac48051-f5d4-4f4f-bada-602243618565', 'volume_size': 1} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1348638076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac48051-f5d4-4f4f-bada-602243618565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d20cd367d284cbe8c3bb33e027eea3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:32Z,use_quota=True,user_id='ad148b9e5c5e4386a98ff06f3cbe23aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Creating volume 6ac48051-f5d4-4f4f-bada-602243618565 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:08:32 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:32 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 1073741824 Jul 07 18:08:32 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Flow 'volume_create_manager' (1ae8c37e-9f7d-4025-b79b-8478065b3c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfc851e-fc88-4ba2-a74a-166fdcf04511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfc851e-fc88-4ba2-a74a-166fdcf04511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1834223708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2f5705-5c7e-4ab2-94c7-bbedc130f045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d20cd367d284cbe8c3bb33e027eea3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:32Z,use_quota=True,user_id='ad148b9e5c5e4386a98ff06f3cbe23aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a41034c-5639-4fb9-a0cc-bff1329fa706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a41034c-5639-4fb9-a0cc-bff1329fa706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac4d99d-a9f9-4fb2-95f4-940aba54160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac4d99d-a9f9-4fb2-95f4-940aba54160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2f5705-5c7e-4ab2-94c7-bbedc130f045', 'volume_name': 'volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed737edb-4a10-4412-b3a4-a79b7034f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed737edb-4a10-4412-b3a4-a79b7034f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9ecb6b-08df-4b6b-b6e6-3f27b198e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:32 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Volume fb2f5705-5c7e-4ab2-94c7-bbedc130f045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045', 'volume_size': 1} Jul 07 18:08:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:33 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 1073741824" returned: 0 in 1.175s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:33 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 Jul 07 18:08:33 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:34 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565" returned: 0 in 0.820s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1834223708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2f5705-5c7e-4ab2-94c7-bbedc130f045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d20cd367d284cbe8c3bb33e027eea3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:32Z,use_quota=True,user_id='ad148b9e5c5e4386a98ff06f3cbe23aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Creating volume fb2f5705-5c7e-4ab2-94c7-bbedc130f045 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:08:34 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909378a2-d419-4d5e-83fa-f5bfcfa0537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac48051-f5d4-4f4f-bada-602243618565', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:34 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 1073741824 Jul 07 18:08:34 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3b747d-df08-4b6c-8775-dbee6254a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:34 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Volume volume-6ac48051-f5d4-4f4f-bada-602243618565 (6ac48051-f5d4-4f4f-bada-602243618565): created successfully Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3b747d-df08-4b6c-8775-dbee6254a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Flow 'volume_create_manager' (51933f37-fc5f-403d-a883-53fc0505e627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:34 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0a7db477-26fa-4d44-8db8-c96ba1aa8c87 tempest-TestServerVolumeAttachmentScenario-566543045 None] Created volume successfully. Jul 07 18:08:35 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 1073741824" returned: 0 in 1.071s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:35 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 Jul 07 18:08:35 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:36 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045" returned: 0 in 0.726s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:08:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9ecb6b-08df-4b6b-b6e6-3f27b198e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e891b94d-f244-49ee-a54b-8749375098e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:36 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Volume volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 (fb2f5705-5c7e-4ab2-94c7-bbedc130f045): created successfully Jul 07 18:08:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e891b94d-f244-49ee-a54b-8749375098e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Flow 'volume_create_manager' (1ae8c37e-9f7d-4025-b79b-8478065b3c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:36 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c479c9c2-69c3-4b2e-807f-91cfb04674cf tempest-TestServerVolumeAttachmentScenario-566543045 None] Created volume successfully. Jul 07 18:08:46 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=4 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:08:46 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=19,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:09:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-ea8b4aff-dbb5-4d6f-9c95-20457e7a5920 req-f7c40082-6369-4168-b84b-38835c4b6baa tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-ea8b4aff-dbb5-4d6f-9c95-20457e7a5920 req-f7c40082-6369-4168-b84b-38835c4b6baa tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:14 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dc28c2-bccc-4600-8716-2b1d6e296dd6]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-ea8b4aff-dbb5-4d6f-9c95-20457e7a5920 req-f7c40082-6369-4168-b84b-38835c4b6baa tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:14 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 Jul 07 18:09:14 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:15 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-ea8b4aff-dbb5-4d6f-9c95-20457e7a5920 req-f7c40082-6369-4168-b84b-38835c4b6baa tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565" returned: 0 in 0.774s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-ea8b4aff-dbb5-4d6f-9c95-20457e7a5920 req-f7c40082-6369-4168-b84b-38835c4b6baa tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-ea8b4aff-dbb5-4d6f-9c95-20457e7a5920 req-f7c40082-6369-4168-b84b-38835c4b6baa tempest-TestServerVolumeAttachmentScenario-566543045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-6ac48051-f5d4-4f4f-bada-602243618565', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37ef4dff-cb4e-4555-9c74-ea77fd184a05', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:09:15 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-ea8b4aff-dbb5-4d6f-9c95-20457e7a5920 req-f7c40082-6369-4168-b84b-38835c4b6baa tempest-TestServerVolumeAttachmentScenario-566543045 None] attachment_update completed successfully. Jul 07 18:09:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:09:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:23 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:09:23 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:24 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.653s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-20066ebd-941a-4667-9490-6fcf7f9f2de0 req-09e9e00f-41c3-477d-b3a9-b089354b5c4a tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-20066ebd-941a-4667-9490-6fcf7f9f2de0 req-09e9e00f-41c3-477d-b3a9-b089354b5c4a tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad050a9e-fc7a-444a-94e2-8928aeb59bfd]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-20066ebd-941a-4667-9490-6fcf7f9f2de0 req-09e9e00f-41c3-477d-b3a9-b089354b5c4a tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:24 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 Jul 07 18:09:24 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:25 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-20066ebd-941a-4667-9490-6fcf7f9f2de0 req-09e9e00f-41c3-477d-b3a9-b089354b5c4a tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045" returned: 0 in 0.718s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-20066ebd-941a-4667-9490-6fcf7f9f2de0 req-09e9e00f-41c3-477d-b3a9-b089354b5c4a tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.732s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-20066ebd-941a-4667-9490-6fcf7f9f2de0 req-09e9e00f-41c3-477d-b3a9-b089354b5c4a tempest-TestServerVolumeAttachmentScenario-566543045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f05350a-1d80-4c4d-b062-c6dfa719dc7e', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:09:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-20066ebd-941a-4667-9490-6fcf7f9f2de0 req-09e9e00f-41c3-477d-b3a9-b089354b5c4a tempest-TestServerVolumeAttachmentScenario-566543045 None] attachment_update completed successfully. Jul 07 18:09:31 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-3d5c042e-271f-4734-8052-c49762cbb5f6 req-7a499fa5-df0d-46c0-b54f-2114bb0b1062 tempest-TestServerVolumeAttachmentScenario-566543045 None] Terminate volume connection completed successfully. Jul 07 18:09:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-3d5c042e-271f-4734-8052-c49762cbb5f6 req-7a499fa5-df0d-46c0-b54f-2114bb0b1062 tempest-TestServerVolumeAttachmentScenario-566543045 None] Deleting attachment 5f05350a-1d80-4c4d-b062-c6dfa719dc7e. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:09:34 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-d092042b-7f49-42c0-afb0-1ccb1762c34d req-ec2ab9fa-c1b8-4558-82b2-d5f26364f0ef tempest-TestServerVolumeAttachmentScenario-566543045 None] Terminate volume connection completed successfully. Jul 07 18:09:34 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-d092042b-7f49-42c0-afb0-1ccb1762c34d req-ec2ab9fa-c1b8-4558-82b2-d5f26364f0ef tempest-TestServerVolumeAttachmentScenario-566543045 None] Deleting attachment 37ef4dff-cb4e-4555-9c74-ea77fd184a05. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:09:44 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:09:44 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:09:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "cinder-fb2f5705-5c7e-4ab2-94c7-bbedc130f045-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "cinder-fb2f5705-5c7e-4ab2-94c7-bbedc130f045-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "cinder-quobyte-fb2f5705-5c7e-4ab2-94c7-bbedc130f045" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "cinder-quobyte-fb2f5705-5c7e-4ab2-94c7-bbedc130f045" acquired by "delete_volume" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[38067761-5ee4-4ea3-a64d-20ab20b2ad6d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:45 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 Jul 07 18:09:45 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:45 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045" returned: 0 in 0.775s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:45 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045 Jul 07 18:09:45 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:46 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fb2f5705-5c7e-4ab2-94c7-bbedc130f045" returned: 0 in 0.630s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "cinder-quobyte-fb2f5705-5c7e-4ab2-94c7-bbedc130f045" released by "delete_volume" :: held 1.450s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Created reservations ['7a73efa5-8f1e-4348-9487-72c91a16c7e8', 'ec78e8b3-a6f3-4ca7-a0d6-0dadbadf8e05', '9c0b178e-ad26-4fd9-891e-6775b982dbbc', 'd2443ec7-ed00-478b-8c42-2fd78ec750f1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:46 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:09:46 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "cinder-6ac48051-f5d4-4f4f-bada-602243618565-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "cinder-6ac48051-f5d4-4f4f-bada-602243618565-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:47 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.644s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:47 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Deleted volume successfully. Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "cinder-quobyte-6ac48051-f5d4-4f4f-bada-602243618565" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-8b1834d8-278c-4878-b03b-e8268c4efd6c tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "cinder-fb2f5705-5c7e-4ab2-94c7-bbedc130f045-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "cinder-quobyte-6ac48051-f5d4-4f4f-bada-602243618565" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c841a42-028d-4771-94c1-fd3d51fb1830]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:47 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 Jul 07 18:09:47 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:48 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565" returned: 0 in 0.749s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:48 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565 Jul 07 18:09:48 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:48 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6ac48051-f5d4-4f4f-bada-602243618565" returned: 0 in 0.644s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "cinder-quobyte-6ac48051-f5d4-4f4f-bada-602243618565" released by "delete_volume" :: held 1.437s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Created reservations ['e2d10517-81e2-44c3-bdca-c2b9f30af248', '5a9e2702-a1d5-4f0c-94be-091d5852bd58', 'ded4b06f-6a23-42ca-9ed0-2d5d0bbd31c1', 'daa82a77-036c-4502-8c32-f962f4008337'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:48 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:09:48 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:49 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.646s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:49 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Deleted volume successfully. Jul 07 18:09:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-59c93c68-66d4-45d4-9ec9-eaea26020145 tempest-TestServerVolumeAttachmentScenario-566543045 None] Lock "cinder-6ac48051-f5d4-4f4f-bada-602243618565-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:58 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=9,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:09:59 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=18,cinder:SELECT=11,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Flow 'volume_create_manager' (68c19bd5-e2da-4e50-aed6-cc2b0e95bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915ea4af-64c8-4d02-b9bc-41392d688a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915ea4af-64c8-4d02-b9bc-41392d688a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-420913436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30164a99-7035-4fa1-8b0f-03bb980c4688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ae33f938bd4251a373a2d400c2511b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:19Z,use_quota=True,user_id='5398fdb2998a43f0aa43d0610dd17daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e0b89f-2386-4231-895f-d80c19a68ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e0b89f-2386-4231-895f-d80c19a68ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49cf9911-9cbf-4cb5-b6ee-d37313bd5a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49cf9911-9cbf-4cb5-b6ee-d37313bd5a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30164a99-7035-4fa1-8b0f-03bb980c4688', 'volume_name': 'volume-30164a99-7035-4fa1-8b0f-03bb980c4688', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a217a6f-2691-4490-b689-6061155caff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a217a6f-2691-4490-b689-6061155caff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bd95a0-b486-463b-aafa-1abe03d970a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Volume 30164a99-7035-4fa1-8b0f-03bb980c4688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30164a99-7035-4fa1-8b0f-03bb980c4688', 'volume_size': 1} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-420913436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30164a99-7035-4fa1-8b0f-03bb980c4688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ae33f938bd4251a373a2d400c2511b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:19Z,use_quota=True,user_id='5398fdb2998a43f0aa43d0610dd17daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Creating volume 30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:19 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:10:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:19 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 1073741824 Jul 07 18:10:19 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:19 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 1073741824" returned: 0 in 0.888s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:20 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 Jul 07 18:10:20 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:20 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688" returned: 0 in 0.661s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32bd95a0-b486-463b-aafa-1abe03d970a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30164a99-7035-4fa1-8b0f-03bb980c4688', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51f9e49-bd34-4181-8b68-66d860ca95e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:20 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Volume volume-30164a99-7035-4fa1-8b0f-03bb980c4688 (30164a99-7035-4fa1-8b0f-03bb980c4688): created successfully Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51f9e49-bd34-4181-8b68-66d860ca95e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Flow 'volume_create_manager' (68c19bd5-e2da-4e50-aed6-cc2b0e95bf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0f0fbaea-7b34-435d-8e72-bfb01fa01c45 tempest-TestStampPattern-1196185864 None] Created volume successfully. Jul 07 18:10:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:10:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:23 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:10:23 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:24 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.732s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:10:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:10:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:10:30 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:10:30 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:10:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7106b20e-94ca-4058-965b-fd450b2811fb req-eb31b4d1-43ef-4c8e-b429-d35ab23b3e23 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7106b20e-94ca-4058-965b-fd450b2811fb req-eb31b4d1-43ef-4c8e-b429-d35ab23b3e23 tempest-TestStampPattern-1196185864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:59 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf624c-9bdd-4887-8319-66def8492c5a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7106b20e-94ca-4058-965b-fd450b2811fb req-eb31b4d1-43ef-4c8e-b429-d35ab23b3e23 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:59 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 Jul 07 18:10:59 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:00 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-7106b20e-94ca-4058-965b-fd450b2811fb req-eb31b4d1-43ef-4c8e-b429-d35ab23b3e23 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688" returned: 0 in 0.770s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-7106b20e-94ca-4058-965b-fd450b2811fb req-eb31b4d1-43ef-4c8e-b429-d35ab23b3e23 tempest-TestStampPattern-1196185864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-7106b20e-94ca-4058-965b-fd450b2811fb req-eb31b4d1-43ef-4c8e-b429-d35ab23b3e23 tempest-TestStampPattern-1196185864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-30164a99-7035-4fa1-8b0f-03bb980c4688', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '282e849d-7cb3-4630-b91f-36a974c3c683', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:11:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-7106b20e-94ca-4058-965b-fd450b2811fb req-eb31b4d1-43ef-4c8e-b429-d35ab23b3e23 tempest-TestStampPattern-1196185864 None] attachment_update completed successfully. Jul 07 18:11:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-c80d9983-fced-4eab-aabd-1cfacff9b232 req-876ed903-061a-403d-9d22-d66685770865 tempest-TestStampPattern-1196185864 None] Terminate volume connection completed successfully. Jul 07 18:11:08 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-c80d9983-fced-4eab-aabd-1cfacff9b232 req-876ed903-061a-403d-9d22-d66685770865 tempest-TestStampPattern-1196185864 None] Deleting attachment 282e849d-7cb3-4630-b91f-36a974c3c683. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:11:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Creating offline snapshot 41246105-4543-443f-bcc6-b6a312657ede of volume 30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:11:11 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c8090c-c10d-4a21-ac92-89fe88337a54]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:11 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 Jul 07 18:11:11 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:11 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688" returned: 0 in 0.869s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:11 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede 1G Jul 07 18:11:11 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:12 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede 1G" returned: 0 in 0.796s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30164a99-7035-4fa1-8b0f-03bb980c4688 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:12 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30164a99-7035-4fa1-8b0f-03bb980c4688 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede Jul 07 18:11:12 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:13 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30164a99-7035-4fa1-8b0f-03bb980c4688 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede" returned: 0 in 0.690s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:13 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede is being set with open permissions: ugo+rw Jul 07 18:11:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:13 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede Jul 07 18:11:13 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:14 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede" returned: 0 in 0.638s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:14 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.info Jul 07 18:11:14 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:14 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.info" returned: 0 in 0.692s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:14 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.info is being set with open permissions: ugo+rw Jul 07 18:11:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:14 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.info Jul 07 18:11:14 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:15 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.info" returned: 0 in 0.639s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.418s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:15 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-58fe8bc9-b1f3-453c-9e49-d3cb4ca952a8 tempest-TestStampPattern-1196185864 None] Create snapshot completed successfully Jul 07 18:11:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:11:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:23 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:11:23 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:24 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.701s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:11:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:11:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:11:25 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Flow 'volume_create_manager' (a556469b-f416-47e1-89db-24e9ba4907ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e53f98-7ca9-43f8-b81f-179e5675e436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e53f98-7ca9-43f8-b81f-179e5675e436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1208894100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55365113-c208-415e-a87b-28a7cfad80d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ae33f938bd4251a373a2d400c2511b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41246105-4543-443f-bcc6-b6a312657ede,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:26Z,use_quota=True,user_id='5398fdb2998a43f0aa43d0610dd17daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced92e08-af65-4758-94d1-3e4162d3d1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced92e08-af65-4758-94d1-3e4162d3d1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01dc261-c32e-4f04-ad23-6670ffe0365a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01dc261-c32e-4f04-ad23-6670ffe0365a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55365113-c208-415e-a87b-28a7cfad80d7', 'volume_name': 'volume-55365113-c208-415e-a87b-28a7cfad80d7', 'volume_size': 1, 'snapshot_id': '41246105-4543-443f-bcc6-b6a312657ede'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542e2965-71fd-4a80-8a24-4cf96268c614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542e2965-71fd-4a80-8a24-4cf96268c614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c3fea2-6ecb-43ee-b641-3df50585f010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:26 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Volume 55365113-c208-415e-a87b-28a7cfad80d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55365113-c208-415e-a87b-28a7cfad80d7', 'volume_size': 1, 'snapshot_id': '41246105-4543-443f-bcc6-b6a312657ede'} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-quobyte-41246105-4543-443f-bcc6-b6a312657ede-55365113-c208-415e-a87b-28a7cfad80d7" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-41246105-4543-443f-bcc6-b6a312657ede-55365113-c208-415e-a87b-28a7cfad80d7" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Creating volume 55365113-c208-415e-a87b-28a7cfad80d7 from snapshot 41246105-4543-443f-bcc6-b6a312657ede {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-quobyte-55365113-c208-415e-a87b-28a7cfad80d7" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-55365113-c208-415e-a87b-28a7cfad80d7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] snapshot: 41246105-4543-443f-bcc6-b6a312657ede, volume: 55365113-c208-415e-a87b-28a7cfad80d7, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd7b113-b3a0-4f98-9c95-a552c7ce0170]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:26 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede Jul 07 18:11:26 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:27 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede" returned: 0 in 0.833s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30164a99-7035-4fa1-8b0f-03bb980c4688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5a91c6-0992-4292-9494-153060e78b45]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:27 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 Jul 07 18:11:27 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:27 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688" returned: 0 in 0.828s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:11:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:28 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 Jul 07 18:11:28 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:33 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7" returned: 0 in 5.143s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:33 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a099851a-d284-4a03-8f4e-8c2b5cb93ddb]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:33 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 Jul 07 18:11:33 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:34 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688" returned: 0 in 1.239s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:34 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:11:34 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Converted 1024.00 MB image at 198.98 MB/s Jul 07 18:11:34 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 is being set with open permissions: ugo+rw Jul 07 18:11:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:34 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 Jul 07 18:11:34 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:35 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7" returned: 0 in 0.828s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-55365113-c208-415e-a87b-28a7cfad80d7" released by "_copy_volume_from_snapshot" :: held 8.983s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-41246105-4543-443f-bcc6-b6a312657ede-55365113-c208-415e-a87b-28a7cfad80d7" released by "_create_volume_from_snapshot" :: held 9.020s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.036s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c3fea2-6ecb-43ee-b641-3df50585f010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55365113-c208-415e-a87b-28a7cfad80d7', 'volume_size': 1, 'snapshot_id': '41246105-4543-443f-bcc6-b6a312657ede'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7858d67-a967-42be-8109-cc125345ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:35 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Volume volume-55365113-c208-415e-a87b-28a7cfad80d7 (55365113-c208-415e-a87b-28a7cfad80d7): created successfully Jul 07 18:11:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7858d67-a967-42be-8109-cc125345ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Flow 'volume_create_manager' (a556469b-f416-47e1-89db-24e9ba4907ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:35 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d831c687-b148-4fd2-b23c-cf48bf011c57 tempest-TestStampPattern-1196185864 None] Created volume successfully. Jul 07 18:11:45 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:11:45 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:12:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:12:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:23 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:12:23 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-60136d66-bda8-4b5d-83cf-b9eb8ec471e2 req-0b3fbee9-af70-4d94-bea6-3f124d639660 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-60136d66-bda8-4b5d-83cf-b9eb8ec471e2 req-0b3fbee9-af70-4d94-bea6-3f124d639660 tempest-TestStampPattern-1196185864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b5b5f1-089d-4c8b-90cb-5c6165b089c5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-60136d66-bda8-4b5d-83cf-b9eb8ec471e2 req-0b3fbee9-af70-4d94-bea6-3f124d639660 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:24 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 Jul 07 18:12:24 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:24 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.702s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:12:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:12:25 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [req-60136d66-bda8-4b5d-83cf-b9eb8ec471e2 req-0b3fbee9-af70-4d94-bea6-3f124d639660 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7" returned: 0 in 0.784s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [req-60136d66-bda8-4b5d-83cf-b9eb8ec471e2 req-0b3fbee9-af70-4d94-bea6-3f124d639660 tempest-TestStampPattern-1196185864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-60136d66-bda8-4b5d-83cf-b9eb8ec471e2 req-0b3fbee9-af70-4d94-bea6-3f124d639660 tempest-TestStampPattern-1196185864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964', 'name': 'volume-55365113-c208-415e-a87b-28a7cfad80d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5315d10-9bfa-4ffd-a614-38b97896f36b', 'enforce_multipath': True} {{(pid=87228) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 07 18:12:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-60136d66-bda8-4b5d-83cf-b9eb8ec471e2 req-0b3fbee9-af70-4d94-bea6-3f124d639660 tempest-TestStampPattern-1196185864 None] attachment_update completed successfully. Jul 07 18:12:31 devstack cinder-volume[87228]: INFO cinder.volume.manager [req-dae1e977-b857-4b55-b5df-7c34c8c0d405 req-ba825ca6-bc69-49d0-95da-44898dfd031a tempest-TestStampPattern-1196185864 None] Terminate volume connection completed successfully. Jul 07 18:12:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [req-dae1e977-b857-4b55-b5df-7c34c8c0d405 req-ba825ca6-bc69-49d0-95da-44898dfd031a tempest-TestStampPattern-1196185864 None] Deleting attachment e5315d10-9bfa-4ffd-a614-38b97896f36b. {{(pid=87228) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 07 18:12:41 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:12:41 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=8 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:12:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-55365113-c208-415e-a87b-28a7cfad80d7-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Lock "cinder-55365113-c208-415e-a87b-28a7cfad80d7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-quobyte-55365113-c208-415e-a87b-28a7cfad80d7" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-55365113-c208-415e-a87b-28a7cfad80d7" acquired by "delete_volume" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:42 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6191fbeb-b053-4512-a4e9-ec2e18977736]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:43 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 Jul 07 18:12:43 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:43 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7" returned: 0 in 0.762s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:43 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7 Jul 07 18:12:43 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:44 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-55365113-c208-415e-a87b-28a7cfad80d7" returned: 0 in 0.617s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-55365113-c208-415e-a87b-28a7cfad80d7" released by "delete_volume" :: held 1.419s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Created reservations ['7a91aa66-ad35-445b-bca1-31bd61542a09', '591a9e7f-f4a5-42a0-b77d-6bf24cc12f72', '3f7a696d-3364-4a1c-b24b-a05577a7f40a', '2f3714b8-0514-4d94-b83a-48e471cfbfb0'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:44 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:12:44 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:45 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.663s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Deleted volume successfully. Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ee2491dd-11a7-4fcb-bdbb-a93d7d75613a tempest-TestStampPattern-1196185864 None] Lock "cinder-55365113-c208-415e-a87b-28a7cfad80d7-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-41246105-4543-443f-bcc6-b6a312657ede-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Lock "cinder-41246105-4543-443f-bcc6-b6a312657ede-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-quobyte-30164a99-7035-4fa1-8b0f-03bb980c4688" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-30164a99-7035-4fa1-8b0f-03bb980c4688" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-quobyte-41246105-4543-443f-bcc6-b6a312657ede" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-41246105-4543-443f-bcc6-b6a312657ede" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Deleting offline snapshot 41246105-4543-443f-bcc6-b6a312657ede of volume 30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] snapshot_file for this snap is: volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[de702399-c093-43cf-8b8a-900afbe34e5b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:45 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede Jul 07 18:12:45 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:46 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede" returned: 0 in 0.737s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30164a99-7035-4fa1-8b0f-03bb980c4688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a175bca9-4f45-44d1-995b-b21f5b4eab9a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:46 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 Jul 07 18:12:46 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:46 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688" returned: 0 in 0.749s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:46 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede Jul 07 18:12:46 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:47 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede" returned: 0 in 0.731s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:47 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede Jul 07 18:12:47 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:48 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688.41246105-4543-443f-bcc6-b6a312657ede" returned: 0 in 0.610s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-41246105-4543-443f-bcc6-b6a312657ede" released by "_delete_snapshot" :: held 2.916s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-30164a99-7035-4fa1-8b0f-03bb980c4688" released by "delete_snapshot" :: held 2.938s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:48 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Created reservations ['f4951d2f-29fc-4aa4-998d-363f2871a82f', '84de34a0-af92-4fe4-b024-eeb0c162b97a', '3d7e7ec0-38a3-4b27-9bc8-1cebfa3b0682', '962bb54c-d510-407e-8642-6059f3be8df3'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Delete snapshot completed successfully. Jul 07 18:12:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5e615a3f-36b2-4e09-adce-8f2e853ecc50 tempest-TestStampPattern-1196185864 None] Lock "cinder-41246105-4543-443f-bcc6-b6a312657ede-delete_snapshot" released by "delete_snapshot" :: held 3.064s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-30164a99-7035-4fa1-8b0f-03bb980c4688-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Lock "cinder-30164a99-7035-4fa1-8b0f-03bb980c4688-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Acquiring lock "cinder-quobyte-30164a99-7035-4fa1-8b0f-03bb980c4688" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-30164a99-7035-4fa1-8b0f-03bb980c4688" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:56 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e80912a-a139-4086-8a9f-c21309c9d3c9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:56 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 Jul 07 18:12:57 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:57 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688" returned: 0 in 0.804s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:57 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688 Jul 07 18:12:57 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:58 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30164a99-7035-4fa1-8b0f-03bb980c4688" returned: 0 in 0.661s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Lock "cinder-quobyte-30164a99-7035-4fa1-8b0f-03bb980c4688" released by "delete_volume" :: held 1.525s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Created reservations ['b91bbf64-eda7-4bb4-97dc-f03a3256b8a9', '7da3ee70-ffc0-4c98-a9ca-435913a7dbe6', '33870302-b0ac-48b8-afa3-735baa96078d', 'e47c6f99-c9b6-4d14-8f85-22af54d1fec0'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:58 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:12:58 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:59 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.667s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:59 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Deleted volume successfully. Jul 07 18:12:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d54d739e-e9f3-4250-8846-3cdc10606108 tempest-TestStampPattern-1196185864 None] Lock "cinder-30164a99-7035-4fa1-8b0f-03bb980c4688-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:08 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=20,cinder:SELECT=17,cinder:INSERT=4 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=14,cinder:INSERT=8,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (adbc4b91-9bfc-4384-a5cd-44d2c2779149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55f2e19-1ff4-4c43-b170-b9bcfca0c6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b55f2e19-1ff4-4c43-b170-b9bcfca0c6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1436142282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e016982-5b63-467f-9de2-954a05e82a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:10Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7c3b5e-4aef-4f4e-8742-515179356cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b7c3b5e-4aef-4f4e-8742-515179356cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849a26af-6926-441e-9faa-80eda22588ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849a26af-6926-441e-9faa-80eda22588ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e016982-5b63-467f-9de2-954a05e82a73', 'volume_name': 'volume-8e016982-5b63-467f-9de2-954a05e82a73', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8921fbee-a274-4112-8ae1-8029c08beb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8921fbee-a274-4112-8ae1-8029c08beb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5313ce-80a4-4db9-8539-1ba742450d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:09 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume 8e016982-5b63-467f-9de2-954a05e82a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e016982-5b63-467f-9de2-954a05e82a73', 'volume_size': 1} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1436142282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e016982-5b63-467f-9de2-954a05e82a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:10Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Creating volume 8e016982-5b63-467f-9de2-954a05e82a73 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:09 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:13:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:09 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 1073741824 Jul 07 18:13:09 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:10 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 1073741824" returned: 0 in 0.910s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:10 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 Jul 07 18:13:10 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:11 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73" returned: 0 in 0.641s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5313ce-80a4-4db9-8539-1ba742450d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e016982-5b63-467f-9de2-954a05e82a73', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7314905c-4e0f-4f58-9016-284bae811155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:11 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume volume-8e016982-5b63-467f-9de2-954a05e82a73 (8e016982-5b63-467f-9de2-954a05e82a73): created successfully Jul 07 18:13:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7314905c-4e0f-4f58-9016-284bae811155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:11 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (adbc4b91-9bfc-4384-a5cd-44d2c2779149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:11 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-88eaeb2b-8926-433d-9eb0-e01ad84dcef5 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created volume successfully. Jul 07 18:13:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Creating offline snapshot eee33e2b-4135-4f1a-bc77-b11466bd5e74 of volume 8e016982-5b63-467f-9de2-954a05e82a73 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:13:12 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb06cc5-fb0c-423a-bdd2-864162c331ce]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:12 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 Jul 07 18:13:12 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:12 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73" returned: 0 in 0.711s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:12 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 1G Jul 07 18:13:12 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:13 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 1G" returned: 0 in 0.833s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e016982-5b63-467f-9de2-954a05e82a73 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:13 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e016982-5b63-467f-9de2-954a05e82a73 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 Jul 07 18:13:13 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:14 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e016982-5b63-467f-9de2-954a05e82a73 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74" returned: 0 in 0.661s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:14 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 is being set with open permissions: ugo+rw Jul 07 18:13:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:14 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 Jul 07 18:13:14 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:14 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74" returned: 0 in 0.607s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:14 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.info Jul 07 18:13:14 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:15 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.info" returned: 0 in 0.662s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:15 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.info is being set with open permissions: ugo+rw Jul 07 18:13:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:15 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.info Jul 07 18:13:15 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:16 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.info" returned: 0 in 0.696s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.258s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b7695d46-f4ac-44ed-a60e-fb0720aa9fda tempest-CreateVolumesFromSnapshotTest-1074933039 None] Create snapshot completed successfully Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (6a90e8f8-088a-49ef-bb49-fd25621d6219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c88f72-1dcb-41c7-b2cc-5b0fd9fbbc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c88f72-1dcb-41c7-b2cc-5b0fd9fbbc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431587380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838e24c2-d265-431a-81db-9d9bd33e8135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7396ed8a-d905-48f8-85be-7efa43b7055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7396ed8a-d905-48f8-85be-7efa43b7055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e641491-059d-4677-bca0-8091ec31d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e641491-059d-4677-bca0-8091ec31d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838e24c2-d265-431a-81db-9d9bd33e8135', 'volume_name': 'volume-838e24c2-d265-431a-81db-9d9bd33e8135', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d806287-aef9-4e80-8537-c8a9c59809b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d806287-aef9-4e80-8537-c8a9c59809b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed545fb-9b25-4498-a5a4-64755a4434fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:17 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume 838e24c2-d265-431a-81db-9d9bd33e8135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838e24c2-d265-431a-81db-9d9bd33e8135', 'volume_size': 1} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-431587380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838e24c2-d265-431a-81db-9d9bd33e8135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Creating volume 838e24c2-d265-431a-81db-9d9bd33e8135 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:17 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:13:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:17 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 1073741824 Jul 07 18:13:17 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (0bdc954e-dce0-4bc3-8913-25c047b50bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f930f7-7102-4ad3-8c36-9c9033d3b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f930f7-7102-4ad3-8c36-9c9033d3b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296082445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3da8244-a025-4920-bd1e-4a6d49b0c006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fe2dea-f3ac-4a36-ac1b-8a404f3cc74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fe2dea-f3ac-4a36-ac1b-8a404f3cc74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb0555e-67a4-40f6-a5b1-8be5d1e7e933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb0555e-67a4-40f6-a5b1-8be5d1e7e933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3da8244-a025-4920-bd1e-4a6d49b0c006', 'volume_name': 'volume-d3da8244-a025-4920-bd1e-4a6d49b0c006', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e3d05f-d3b8-4adb-80c2-e4ed8c459b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e3d05f-d3b8-4adb-80c2-e4ed8c459b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe555db7-13c5-498b-8802-96d3ec2d9da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume d3da8244-a025-4920-bd1e-4a6d49b0c006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3da8244-a025-4920-bd1e-4a6d49b0c006', 'volume_size': 1} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (4fa7ef25-249b-41e7-b0a8-55b5ce7a1364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62155c3d-daae-4eae-956f-40fcac709733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62155c3d-daae-4eae-956f-40fcac709733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402773656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76a0b31-3bd9-4e34-85ec-d0419dd04c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255ba4d0-f6ae-4b69-b045-bf5ef7c74aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255ba4d0-f6ae-4b69-b045-bf5ef7c74aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0928dbf7-61f8-4f96-b563-06e6e825764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0928dbf7-61f8-4f96-b563-06e6e825764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd76a0b31-3bd9-4e34-85ec-d0419dd04c56', 'volume_name': 'volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b957c1-e9fe-4fa5-8936-cb0ae960c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b957c1-e9fe-4fa5-8936-cb0ae960c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c0274d-76cf-4f8d-9b8f-fae818bc681c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume d76a0b31-3bd9-4e34-85ec-d0419dd04c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56', 'volume_size': 1} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:18 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 1073741824" returned: 0 in 0.953s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:18 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 Jul 07 18:13:18 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (a0a0092b-b794-4637-8e4a-29376584de82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cb97a2-5ec8-4765-bf39-f2dca4bc79cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83cb97a2-5ec8-4765-bf39-f2dca4bc79cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-49934402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e32c6c2-e1e0-49b0-99ec-b71fecf94924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:19Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933c23cb-07e6-4145-b79f-d2bcd9c801a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (933c23cb-07e6-4145-b79f-d2bcd9c801a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5ad622-fccd-41cc-a76b-1023836e73dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5ad622-fccd-41cc-a76b-1023836e73dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e32c6c2-e1e0-49b0-99ec-b71fecf94924', 'volume_name': 'volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bad7bc-7699-4d05-b4a8-be4eb228675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bad7bc-7699-4d05-b4a8-be4eb228675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d54f0b5-aeff-489f-a948-4e741ee78b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume 5e32c6c2-e1e0-49b0-99ec-b71fecf94924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924', 'volume_size': 1} Jul 07 18:13:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (1c577a62-3ced-4aa2-b761-73a6cd79a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ba29a7-9bf1-4196-9785-d26d92a9c55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ba29a7-9bf1-4196-9785-d26d92a9c55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2107702250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d9dfe3-75d9-40eb-b2de-af31612a93a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:19Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d24791-2e77-4744-a5cf-c7082d67f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d24791-2e77-4744-a5cf-c7082d67f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ee7a0c-436d-413e-8cb5-b6d6eb599eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ee7a0c-436d-413e-8cb5-b6d6eb599eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d9dfe3-75d9-40eb-b2de-af31612a93a7', 'volume_name': 'volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d0a4ed-7894-4141-baa8-a03fce5f9c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d0a4ed-7894-4141-baa8-a03fce5f9c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a21c20-f9c3-4957-99ef-b3bd293116b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume b8d9dfe3-75d9-40eb-b2de-af31612a93a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7', 'volume_size': 1} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:19 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135" returned: 0 in 0.656s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296082445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3da8244-a025-4920-bd1e-4a6d49b0c006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Creating volume d3da8244-a025-4920-bd1e-4a6d49b0c006 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:19 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed545fb-9b25-4498-a5a4-64755a4434fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838e24c2-d265-431a-81db-9d9bd33e8135', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 1073741824 Jul 07 18:13:19 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef8dcc6-5f23-4d8b-9a79-3ca18d40b04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume volume-838e24c2-d265-431a-81db-9d9bd33e8135 (838e24c2-d265-431a-81db-9d9bd33e8135): created successfully Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aef8dcc6-5f23-4d8b-9a79-3ca18d40b04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (6a90e8f8-088a-49ef-bb49-fd25621d6219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-897fbd51-40eb-401e-9240-0cb72b784d11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created volume successfully. Jul 07 18:13:20 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 1073741824" returned: 0 in 0.829s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:20 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 Jul 07 18:13:20 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:20 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006" returned: 0 in 0.699s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.479s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402773656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d76a0b31-3bd9-4e34-85ec-d0419dd04c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Creating volume d76a0b31-3bd9-4e34-85ec-d0419dd04c56 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:20 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:13:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:20 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 1073741824 Jul 07 18:13:20 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe555db7-13c5-498b-8802-96d3ec2d9da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3da8244-a025-4920-bd1e-4a6d49b0c006', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3eb181b-c322-41bd-86a6-f593fe22550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:21 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 (d3da8244-a025-4920-bd1e-4a6d49b0c006): created successfully Jul 07 18:13:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3eb181b-c322-41bd-86a6-f593fe22550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (0bdc954e-dce0-4bc3-8913-25c047b50bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-496b64bc-f999-4586-929d-e3dc9e66d994 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created volume successfully. Jul 07 18:13:21 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 1073741824" returned: 0 in 0.906s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:21 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 Jul 07 18:13:21 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:22 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56" returned: 0 in 0.711s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.782s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-49934402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e32c6c2-e1e0-49b0-99ec-b71fecf94924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:19Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Creating volume 5e32c6c2-e1e0-49b0-99ec-b71fecf94924 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:22 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c0274d-76cf-4f8d-9b8f-fae818bc681c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4527fa5e-dac2-42b8-b171-54dc4edc18c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:22 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 1073741824 Jul 07 18:13:22 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:22 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 (d76a0b31-3bd9-4e34-85ec-d0419dd04c56): created successfully Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4527fa5e-dac2-42b8-b171-54dc4edc18c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (4fa7ef25-249b-41e7-b0a8-55b5ce7a1364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:22 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-96784f50-7f13-4900-9b4f-77a91dff7287 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created volume successfully. Jul 07 18:13:23 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 1073741824" returned: 0 in 0.833s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:23 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 Jul 07 18:13:23 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:23 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:13:23 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:24 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924" returned: 0 in 0.729s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.030s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2107702250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d9dfe3-75d9-40eb-b2de-af31612a93a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e121861681054cb1a01b00b30f26ba57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:19Z,use_quota=True,user_id='785bf6358f87488994f366a8f27c0c5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Creating volume b8d9dfe3-75d9-40eb-b2de-af31612a93a7 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:24 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d54f0b5-aeff-489f-a948-4e741ee78b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:24 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 1073741824 Jul 07 18:13:24 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfaac31-7295-40f2-8956-5c3ec1af0d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:24 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 (5e32c6c2-e1e0-49b0-99ec-b71fecf94924): created successfully Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcfaac31-7295-40f2-8956-5c3ec1af0d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (a0a0092b-b794-4637-8e4a-29376584de82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ec442c37-7f63-44af-bcde-e4630c6cd381 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created volume successfully. Jul 07 18:13:24 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.718s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:13:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:13:25 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 1073741824" returned: 0 in 0.934s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:25 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 Jul 07 18:13:25 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:25 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7" returned: 0 in 0.706s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a21c20-f9c3-4957-99ef-b3bd293116b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab72ee66-948e-4665-add8-e9f2d039ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:26 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Volume volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 (b8d9dfe3-75d9-40eb-b2de-af31612a93a7): created successfully Jul 07 18:13:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab72ee66-948e-4665-add8-e9f2d039ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Flow 'volume_create_manager' (1c577a62-3ced-4aa2-b761-73a6cd79a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:26 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-7cf74c25-d16b-4db9-bc85-7585d84e551a tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created volume successfully. Jul 07 18:13:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-b8d9dfe3-75d9-40eb-b2de-af31612a93a7-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-b8d9dfe3-75d9-40eb-b2de-af31612a93a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-quobyte-b8d9dfe3-75d9-40eb-b2de-af31612a93a7" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-b8d9dfe3-75d9-40eb-b2de-af31612a93a7" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6972d-8587-49b8-8b9a-956d9d9f51e7]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:27 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 Jul 07 18:13:27 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:27 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7" returned: 0 in 0.830s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:27 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7 Jul 07 18:13:27 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:28 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b8d9dfe3-75d9-40eb-b2de-af31612a93a7" returned: 0 in 0.862s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-b8d9dfe3-75d9-40eb-b2de-af31612a93a7" released by "delete_volume" :: held 1.734s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created reservations ['0ceab478-a3b8-4407-8617-092063b48571', 'a9ea63cc-299d-4a0a-9473-db277c5a172b', 'e3ac1432-1e09-4856-9915-fcf4d194454f', '478bd936-3a8b-474d-bb0e-271743536d45'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:28 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:13:28 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-5e32c6c2-e1e0-49b0-99ec-b71fecf94924-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-5e32c6c2-e1e0-49b0-99ec-b71fecf94924-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-quobyte-5e32c6c2-e1e0-49b0-99ec-b71fecf94924" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-5e32c6c2-e1e0-49b0-99ec-b71fecf94924" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46f171b-0e23-4bcb-bdc6-a35322ead7be]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:29 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 Jul 07 18:13:29 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:29 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.746s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Deleted volume successfully. Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5d573e9d-7eb0-44a0-a0f4-5fbabc65330c tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-b8d9dfe3-75d9-40eb-b2de-af31612a93a7-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:29 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924" returned: 0 in 0.783s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:29 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924 Jul 07 18:13:29 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:30 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-5e32c6c2-e1e0-49b0-99ec-b71fecf94924" returned: 0 in 0.640s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-5e32c6c2-e1e0-49b0-99ec-b71fecf94924" released by "delete_volume" :: held 1.471s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created reservations ['479d635f-6298-494f-a326-8547eee0a91c', 'ae8e330e-3dbf-44c1-bb09-a9826282b6fe', 'a8e4684b-6dcc-4d7d-b5f1-e4a952eaa570', '9d0ec6e0-074e-4cb1-b942-cd8194d6b019'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:30 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:13:30 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-d76a0b31-3bd9-4e34-85ec-d0419dd04c56-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-d76a0b31-3bd9-4e34-85ec-d0419dd04c56-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-quobyte-d76a0b31-3bd9-4e34-85ec-d0419dd04c56" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-d76a0b31-3bd9-4e34-85ec-d0419dd04c56" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:31 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.686s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1bf0fd-3345-4781-a2d3-e5067d385a6d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:31 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Deleted volume successfully. Jul 07 18:13:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f74aa153-fe93-4b1a-9e36-517db57f3622 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-5e32c6c2-e1e0-49b0-99ec-b71fecf94924-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:31 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 Jul 07 18:13:31 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:32 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56" returned: 0 in 0.783s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:32 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56 Jul 07 18:13:32 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:32 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d76a0b31-3bd9-4e34-85ec-d0419dd04c56" returned: 0 in 0.666s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-d76a0b31-3bd9-4e34-85ec-d0419dd04c56" released by "delete_volume" :: held 1.505s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:32 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created reservations ['214eb238-987d-4d00-ae4f-0ec4492c7378', '75d81a60-376d-4316-ad96-242237d9c503', '996f4a6c-f628-4cd0-923b-3b534018d80d', 'b59eeef6-938c-410d-8d72-fb7baaca8a53'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:33 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:13:33 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-d3da8244-a025-4920-bd1e-4a6d49b0c006-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-d3da8244-a025-4920-bd1e-4a6d49b0c006-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-quobyte-d3da8244-a025-4920-bd1e-4a6d49b0c006" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-d3da8244-a025-4920-bd1e-4a6d49b0c006" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bb33b9-6cde-49ac-ba74-054eb08e99b1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:33 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.678s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Deleted volume successfully. Jul 07 18:13:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a83bdb75-4781-46c6-8b95-dbe57875d98f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-d76a0b31-3bd9-4e34-85ec-d0419dd04c56-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:33 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 Jul 07 18:13:33 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:34 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006" returned: 0 in 0.768s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:34 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006 Jul 07 18:13:34 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:35 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d3da8244-a025-4920-bd1e-4a6d49b0c006" returned: 0 in 0.644s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-d3da8244-a025-4920-bd1e-4a6d49b0c006" released by "delete_volume" :: held 1.453s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created reservations ['63d29467-fdd4-4b80-858c-2b37b919667a', '90b584c7-bb27-4c66-9a36-e28bc22eb5db', '5eb38264-c467-4258-922e-598d7a4f4104', '2b65133b-4dad-4b11-a0a3-fc271e1608c1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:35 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:13:35 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-838e24c2-d265-431a-81db-9d9bd33e8135-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-838e24c2-d265-431a-81db-9d9bd33e8135-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:35 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-quobyte-838e24c2-d265-431a-81db-9d9bd33e8135" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.678s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:35 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Deleted volume successfully. Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-838e24c2-d265-431a-81db-9d9bd33e8135" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-aa978cb1-b1c0-465b-87ba-3e3c50c3e60f tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-d3da8244-a025-4920-bd1e-4a6d49b0c006-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f26b07-0ed5-49e5-839c-98abbbbddb7d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:36 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 Jul 07 18:13:36 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:36 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135" returned: 0 in 0.716s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:36 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135 Jul 07 18:13:36 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:37 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-838e24c2-d265-431a-81db-9d9bd33e8135" returned: 0 in 0.625s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-838e24c2-d265-431a-81db-9d9bd33e8135" released by "delete_volume" :: held 1.381s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created reservations ['a0695577-586f-4165-9842-de280be333bf', 'e81bea73-d77c-46ba-9e05-ab05524e1cca', 'a731a2ed-90bb-456d-86e4-3ac09f5705c3', '71048fbc-443c-44f6-912f-d37b42a9444b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:37 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:13:37 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:38 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-eee33e2b-4135-4f1a-bc77-b11466bd5e74-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.661s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:38 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Deleted volume successfully. Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-eee33e2b-4135-4f1a-bc77-b11466bd5e74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-quobyte-8e016982-5b63-467f-9de2-954a05e82a73" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-8e016982-5b63-467f-9de2-954a05e82a73" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-quobyte-eee33e2b-4135-4f1a-bc77-b11466bd5e74" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f78fde42-d2e4-47ee-9131-0664e755ba11 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-838e24c2-d265-431a-81db-9d9bd33e8135-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-eee33e2b-4135-4f1a-bc77-b11466bd5e74" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Deleting offline snapshot eee33e2b-4135-4f1a-bc77-b11466bd5e74 of volume 8e016982-5b63-467f-9de2-954a05e82a73 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] snapshot_file for this snap is: volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21bc5fd-4f55-4f83-8404-a672b3e4556c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:38 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 Jul 07 18:13:38 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:38 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74" returned: 0 in 0.725s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e016982-5b63-467f-9de2-954a05e82a73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d967cd-d225-4a8e-aa10-e60424cef054]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:39 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 Jul 07 18:13:39 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:39 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73" returned: 0 in 0.730s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:39 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 Jul 07 18:13:39 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:40 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74" returned: 0 in 0.746s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:40 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74 Jul 07 18:13:40 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:41 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73.eee33e2b-4135-4f1a-bc77-b11466bd5e74" returned: 0 in 0.638s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-eee33e2b-4135-4f1a-bc77-b11466bd5e74" released by "_delete_snapshot" :: held 2.960s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-8e016982-5b63-467f-9de2-954a05e82a73" released by "delete_snapshot" :: held 2.983s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created reservations ['02e66b05-bedd-4cf0-8954-a0db990daa10', '8b3ba453-c895-47eb-b439-6b03f6bfec31', 'dba19293-b3b6-4d26-a784-7e896ca21582', '93f7cebe-d12b-4025-9c4d-e55b7a3d0d19'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Delete snapshot completed successfully. Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f7d3791e-cf37-4fe8-b38b-4dfe1946c361 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-eee33e2b-4135-4f1a-bc77-b11466bd5e74-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-8e016982-5b63-467f-9de2-954a05e82a73-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-8e016982-5b63-467f-9de2-954a05e82a73-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "cinder-quobyte-8e016982-5b63-467f-9de2-954a05e82a73" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-8e016982-5b63-467f-9de2-954a05e82a73" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[878908cf-2155-4b67-89ed-81f2855c9716]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:41 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 Jul 07 18:13:41 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:42 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73" returned: 0 in 0.748s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:42 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73 Jul 07 18:13:42 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:42 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8e016982-5b63-467f-9de2-954a05e82a73" returned: 0 in 0.636s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-quobyte-8e016982-5b63-467f-9de2-954a05e82a73" released by "delete_volume" :: held 1.458s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Created reservations ['f0e64a83-8d8a-4862-a3a0-d0514bceba41', '74cd9719-e8aa-47e4-a0a3-3624a6773967', 'b07118e5-8aa8-4617-8b8a-8e202deabdf1', '6f5c352e-00df-417a-93cb-b9f1967e7775'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:42 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:13:42 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:43 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.642s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:43 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Deleted volume successfully. Jul 07 18:13:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-15a47886-3620-44bf-abe4-1c2f476811c3 tempest-CreateVolumesFromSnapshotTest-1074933039 None] Lock "cinder-8e016982-5b63-467f-9de2-954a05e82a73-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Flow 'volume_create_manager' (72fd1563-653a-424e-9262-852c27e303a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470356eb-7576-45f5-aca4-847543a67511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470356eb-7576-45f5-aca4-847543a67511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f904b64b-4e23-443e-a3ee-5d88003c442c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3745f5ab9ad442d3a3f0451c9277b584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:46Z,use_quota=True,user_id='90ff007760b74ea9a33df074d83038e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0bdd9f-3d12-493b-b50e-ef83a3a0f9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0bdd9f-3d12-493b-b50e-ef83a3a0f9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49063a80-0dd8-4de8-8482-f70b79a02af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49063a80-0dd8-4de8-8482-f70b79a02af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f904b64b-4e23-443e-a3ee-5d88003c442c', 'volume_name': 'volume-f904b64b-4e23-443e-a3ee-5d88003c442c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b6967d-fcce-4d1c-8d17-cd0f2a665821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b6967d-fcce-4d1c-8d17-cd0f2a665821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c665465-f10b-4b91-ae7b-99752d3eca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:46 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Volume f904b64b-4e23-443e-a3ee-5d88003c442c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f904b64b-4e23-443e-a3ee-5d88003c442c', 'volume_size': 1} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f904b64b-4e23-443e-a3ee-5d88003c442c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3745f5ab9ad442d3a3f0451c9277b584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:46Z,use_quota=True,user_id='90ff007760b74ea9a33df074d83038e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Creating volume f904b64b-4e23-443e-a3ee-5d88003c442c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:46 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:13:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:46 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c 1073741824 Jul 07 18:13:46 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:47 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c 1073741824" returned: 0 in 0.796s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:47 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c Jul 07 18:13:47 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:47 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c" returned: 0 in 0.667s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:47 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c665465-f10b-4b91-ae7b-99752d3eca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f904b64b-4e23-443e-a3ee-5d88003c442c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:47 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a394e5c-5c57-4f41-b6fd-61425cd8fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:48 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Volume volume-f904b64b-4e23-443e-a3ee-5d88003c442c (f904b64b-4e23-443e-a3ee-5d88003c442c): created successfully Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a394e5c-5c57-4f41-b6fd-61425cd8fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Flow 'volume_create_manager' (72fd1563-653a-424e-9262-852c27e303a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a43151b8-542a-485f-a3c4-e30dd4a2c019 tempest-CinderUnicodeTest-918490161 None] Created volume successfully. Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Flow 'volume_create_manager' (b66c8d86-f7d6-47d2-a50d-2c9b9ce80bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5e9030-d9fe-469f-ac1e-7e53a33ad6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5e9030-d9fe-469f-ac1e-7e53a33ad6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-635736814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e243ae53-552a-4aba-bfd7-d96cef5e701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3745f5ab9ad442d3a3f0451c9277b584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:49Z,use_quota=True,user_id='90ff007760b74ea9a33df074d83038e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166dbd83-1875-408f-a2f5-d9ee37ecb3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166dbd83-1875-408f-a2f5-d9ee37ecb3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da7155f-e3a6-4683-bd02-1ae0bba4d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da7155f-e3a6-4683-bd02-1ae0bba4d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e243ae53-552a-4aba-bfd7-d96cef5e701d', 'volume_name': 'volume-e243ae53-552a-4aba-bfd7-d96cef5e701d', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98058206-c5cd-4219-b896-939a2838cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98058206-c5cd-4219-b896-939a2838cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6f482b-6750-43e4-9b7c-80ba1a02a6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:49 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Volume e243ae53-552a-4aba-bfd7-d96cef5e701d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e243ae53-552a-4aba-bfd7-d96cef5e701d', 'volume_size': 1} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-635736814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e243ae53-552a-4aba-bfd7-d96cef5e701d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3745f5ab9ad442d3a3f0451c9277b584',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:49Z,use_quota=True,user_id='90ff007760b74ea9a33df074d83038e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Creating volume e243ae53-552a-4aba-bfd7-d96cef5e701d {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:49 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:49 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d 1073741824 Jul 07 18:13:49 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:49 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d 1073741824" returned: 0 in 0.819s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:49 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d Jul 07 18:13:49 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:50 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d" returned: 0 in 0.665s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6f482b-6750-43e4-9b7c-80ba1a02a6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e243ae53-552a-4aba-bfd7-d96cef5e701d', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b718ac9c-143a-4f9d-835b-250fa610609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:50 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Volume volume-e243ae53-552a-4aba-bfd7-d96cef5e701d (e243ae53-552a-4aba-bfd7-d96cef5e701d): created successfully Jul 07 18:13:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b718ac9c-143a-4f9d-835b-250fa610609c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Flow 'volume_create_manager' (b66c8d86-f7d6-47d2-a50d-2c9b9ce80bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-28659042-ff68-4eb1-9aff-e70faa65836e tempest-CinderUnicodeTest-918490161 None] Created volume successfully. Jul 07 18:13:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Creating offline snapshot 8d68a785-4440-4de7-9410-01ec268f3f88 of volume e243ae53-552a-4aba-bfd7-d96cef5e701d {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:13:51 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[90db5868-5929-4237-b773-a4f26607c497]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:51 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d Jul 07 18:13:51 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:51 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d" returned: 0 in 0.731s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:52 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 1G Jul 07 18:13:52 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:52 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 1G" returned: 0 in 0.777s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e243ae53-552a-4aba-bfd7-d96cef5e701d -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:52 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e243ae53-552a-4aba-bfd7-d96cef5e701d -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 Jul 07 18:13:52 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:53 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e243ae53-552a-4aba-bfd7-d96cef5e701d -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88" returned: 0 in 0.640s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:53 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 is being set with open permissions: ugo+rw Jul 07 18:13:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:53 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 Jul 07 18:13:53 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:54 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88" returned: 0 in 0.640s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:54 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.info Jul 07 18:13:54 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:54 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.info" returned: 0 in 0.631s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:54 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.info is being set with open permissions: ugo+rw Jul 07 18:13:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:54 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.info Jul 07 18:13:54 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:55 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.info" returned: 0 in 0.599s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.104s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-05765d8e-bb70-4868-9bc5-ecd8f7a5880e tempest-CinderUnicodeTest-918490161 None] Create snapshot completed successfully Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Acquiring lock "cinder-8d68a785-4440-4de7-9410-01ec268f3f88-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Lock "cinder-8d68a785-4440-4de7-9410-01ec268f3f88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Acquiring lock "cinder-quobyte-e243ae53-552a-4aba-bfd7-d96cef5e701d" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Lock "cinder-quobyte-e243ae53-552a-4aba-bfd7-d96cef5e701d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Acquiring lock "cinder-quobyte-8d68a785-4440-4de7-9410-01ec268f3f88" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Lock "cinder-quobyte-8d68a785-4440-4de7-9410-01ec268f3f88" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Deleting offline snapshot 8d68a785-4440-4de7-9410-01ec268f3f88 of volume e243ae53-552a-4aba-bfd7-d96cef5e701d {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] snapshot_file for this snap is: volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12dd56e-7767-401a-8b56-15e7e4a174de]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:56 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 Jul 07 18:13:56 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:57 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88" returned: 0 in 0.763s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:57 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e243ae53-552a-4aba-bfd7-d96cef5e701d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:13:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c201e276-708b-4dc0-88ba-6a0bac5095c9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:57 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d Jul 07 18:13:57 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:58 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d" returned: 0 in 0.753s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:58 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 Jul 07 18:13:58 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:58 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88" returned: 0 in 0.726s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:58 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88 Jul 07 18:13:58 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:59 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d.8d68a785-4440-4de7-9410-01ec268f3f88" returned: 0 in 0.650s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Lock "cinder-quobyte-8d68a785-4440-4de7-9410-01ec268f3f88" released by "_delete_snapshot" :: held 2.999s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Lock "cinder-quobyte-e243ae53-552a-4aba-bfd7-d96cef5e701d" released by "delete_snapshot" :: held 3.026s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:59 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Created reservations ['91634e19-7b9f-46ab-9afa-c0f19b1bd0d9', 'b7643389-1d61-44c0-b6b2-abdd1935d508', '535ab4e7-b6b8-496f-bf64-cb438d28de9d', '2fc611cd-b391-4262-a8b2-0dc37875899e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Delete snapshot completed successfully. Jul 07 18:13:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2c4ca377-2070-4f84-a7f9-ee406176979a tempest-CinderUnicodeTest-918490161 None] Lock "cinder-8d68a785-4440-4de7-9410-01ec268f3f88-delete_snapshot" released by "delete_snapshot" :: held 3.173s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Acquiring lock "cinder-e243ae53-552a-4aba-bfd7-d96cef5e701d-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Lock "cinder-e243ae53-552a-4aba-bfd7-d96cef5e701d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Acquiring lock "cinder-quobyte-e243ae53-552a-4aba-bfd7-d96cef5e701d" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Lock "cinder-quobyte-e243ae53-552a-4aba-bfd7-d96cef5e701d" acquired by "delete_volume" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aa4217-f2eb-4ed2-a2c0-0187c32b612d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:00 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d Jul 07 18:14:00 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:01 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d" returned: 0 in 0.834s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:01 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d Jul 07 18:14:01 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:02 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e243ae53-552a-4aba-bfd7-d96cef5e701d" returned: 0 in 0.645s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Lock "cinder-quobyte-e243ae53-552a-4aba-bfd7-d96cef5e701d" released by "delete_volume" :: held 1.540s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Created reservations ['deaefc47-31c0-49b4-a151-c3fda4f20304', '06e1d87a-62e0-4d2e-a146-f8bdb7ba51b1', 'd4a4fb8a-1fc6-4074-87f6-4df5cda2af9d', '6aad9b53-b2c8-47bd-a9c2-c042ca756a7d'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:02 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:02 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Acquiring lock "cinder-f904b64b-4e23-443e-a3ee-5d88003c442c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Lock "cinder-f904b64b-4e23-443e-a3ee-5d88003c442c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Acquiring lock "cinder-quobyte-f904b64b-4e23-443e-a3ee-5d88003c442c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Lock "cinder-quobyte-f904b64b-4e23-443e-a3ee-5d88003c442c" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[337eacb6-5b08-45e6-a91f-5240ad00d5d4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:03 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.684s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Deleted volume successfully. Jul 07 18:14:03 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c Jul 07 18:14:03 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c481a5aa-c0b5-4a7f-b2d7-25a0bbb33f1b tempest-CinderUnicodeTest-918490161 None] Lock "cinder-e243ae53-552a-4aba-bfd7-d96cef5e701d-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:03 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c" returned: 0 in 0.820s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:03 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c Jul 07 18:14:03 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:04 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-f904b64b-4e23-443e-a3ee-5d88003c442c" returned: 0 in 0.737s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Lock "cinder-quobyte-f904b64b-4e23-443e-a3ee-5d88003c442c" released by "delete_volume" :: held 1.610s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Created reservations ['da800c10-eafb-47c2-b5bc-338563c42265', 'a623d2d5-6a67-4069-8ada-de71fb276dce', 'e0bece62-51f6-4436-b711-d628a07f2971', '706280b5-b9fe-4454-ac51-e0360b9ea541'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:04 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:04 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:05 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.732s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:05 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:05 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Deleted volume successfully. Jul 07 18:14:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-67e671df-b55f-4b8e-aa43-455fa20c3e58 tempest-CinderUnicodeTest-918490161 None] Lock "cinder-f904b64b-4e23-443e-a3ee-5d88003c442c-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:14 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=81,cinder:UPDATE=96,cinder:INSERT=28,cinder:DELETE=10 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:14:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=109,cinder:SELECT=68,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (adbfe764-c585-47d6-8f49-75c9a32f020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f9421b-f6ee-4ae7-aa0d-d5ed62d40e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f9421b-f6ee-4ae7-aa0d-d5ed62d40e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1855864309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffdf48c-7d3c-4330-8139-f7d23d2965d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:17Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febf9045-cd32-4030-97fc-469801de21b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febf9045-cd32-4030-97fc-469801de21b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d65c7ce-7b43-4e46-8030-ec54d1cecde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d65c7ce-7b43-4e46-8030-ec54d1cecde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fffdf48c-7d3c-4330-8139-f7d23d2965d5', 'volume_name': 'volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4143280a-57e6-4e29-8138-88ae7facc7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4143280a-57e6-4e29-8138-88ae7facc7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f671ea9-8f4c-4c34-9bab-0fa4c19b8d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:17 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume fffdf48c-7d3c-4330-8139-f7d23d2965d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5', 'volume_size': 1} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1855864309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffdf48c-7d3c-4330-8139-f7d23d2965d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:17Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Creating volume fffdf48c-7d3c-4330-8139-f7d23d2965d5 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:17 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:17 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 1073741824 Jul 07 18:14:17 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (22ab72d6-32c0-4415-99f4-40c882e7d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df688347-1be9-4c3f-930a-f776283af4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df688347-1be9-4c3f-930a-f776283af4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343314024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82bf345-2384-4074-a442-4bcc14098d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:18Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1a6fb2-0e46-45db-87b6-d4cc09ca4549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec1a6fb2-0e46-45db-87b6-d4cc09ca4549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600522ba-662d-4d49-8d44-cd3047709444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600522ba-662d-4d49-8d44-cd3047709444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82bf345-2384-4074-a442-4bcc14098d38', 'volume_name': 'volume-b82bf345-2384-4074-a442-4bcc14098d38', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb35e7d-a67a-4116-ac33-f2dc1e633776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb35e7d-a67a-4116-ac33-f2dc1e633776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86005f82-4a2f-410e-9d89-e35bd485a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Volume b82bf345-2384-4074-a442-4bcc14098d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82bf345-2384-4074-a442-4bcc14098d38', 'volume_size': 1} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:18 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 1073741824" returned: 0 in 1.177s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:18 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 Jul 07 18:14:18 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (83dec949-c717-4c5f-84e5-7c9ff471fdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cea28c-26af-4ad5-b28a-045756ce07af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (31055b7d-2829-4087-bc26-0aea2e5ba923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886b3500-efc2-4e82-8649-4d179636360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cea28c-26af-4ad5-b28a-045756ce07af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731177247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae54b9de-aa37-482f-96bc-89b0f5d302c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:19Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312c7625-c07a-4d3e-91a5-2d9fcbe6e96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (312c7625-c07a-4d3e-91a5-2d9fcbe6e96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a3091c-1b27-4277-9da7-5cff5cf1bd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a3091c-1b27-4277-9da7-5cff5cf1bd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae54b9de-aa37-482f-96bc-89b0f5d302c7', 'volume_name': 'volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e13082c-0e5e-47df-9ffc-30b1babf69a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e13082c-0e5e-47df-9ffc-30b1babf69a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63b367f-6ae9-4d2c-8cd0-ce8dd9f7841f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Volume ae54b9de-aa37-482f-96bc-89b0f5d302c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7', 'volume_size': 1} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5" returned: 0 in 0.853s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886b3500-efc2-4e82-8649-4d179636360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412555773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a17fcb-aa96-4810-8a03-38a91ecf8a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:19Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e005f597-800c-448c-a50f-5143710d5aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e005f597-800c-448c-a50f-5143710d5aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7ea4e3-0ef5-43f1-8839-829d9380f999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7ea4e3-0ef5-43f1-8839-829d9380f999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a17fcb-aa96-4810-8a03-38a91ecf8a4c', 'volume_name': 'volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7baa9281-c331-4669-ac01-5c3a5cd28ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7baa9281-c331-4669-ac01-5c3a5cd28ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295d988c-1596-41b9-9c8c-6c4f3b7dd3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Volume 03a17fcb-aa96-4810-8a03-38a91ecf8a4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c', 'volume_size': 1} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412555773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a17fcb-aa96-4810-8a03-38a91ecf8a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:19Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Creating volume 03a17fcb-aa96-4810-8a03-38a91ecf8a4c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:19 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:19 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c 1073741824 Jul 07 18:14:19 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f671ea9-8f4c-4c34-9bab-0fa4c19b8d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514ca134-5ac5-410f-bcb6-709b32b90bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (2635bbde-9897-4545-a4a5-e9b4c1f61064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d3389f-3249-4022-806e-47b830c96688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 (fffdf48c-7d3c-4330-8139-f7d23d2965d5): created successfully Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (514ca134-5ac5-410f-bcb6-709b32b90bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (adbfe764-c585-47d6-8f49-75c9a32f020b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d3389f-3249-4022-806e-47b830c96688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-721491722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d822581-a095-4563-8035-264ba723c7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:19Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b306f95-27b1-4643-a24e-f6000c505b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b306f95-27b1-4643-a24e-f6000c505b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af02c88b-ac9a-44b7-bad3-2812556963e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af02c88b-ac9a-44b7-bad3-2812556963e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d822581-a095-4563-8035-264ba723c7a2', 'volume_name': 'volume-8d822581-a095-4563-8035-264ba723c7a2', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1abca3f-bd9d-46d3-9612-273d4a0c3e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1abca3f-bd9d-46d3-9612-273d4a0c3e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3ab063-a3b3-4c40-95ce-7d5279c9d01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Volume 8d822581-a095-4563-8035-264ba723c7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d822581-a095-4563-8035-264ba723c7a2', 'volume_size': 1} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bf9ec240-c583-4270-a613-abf364e7810d tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created volume successfully. Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (f2cd348f-5a12-4cdb-95c7-fe7185b6e0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ac8e29-2f0b-4c1e-a5a8-62939cb64811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ac8e29-2f0b-4c1e-a5a8-62939cb64811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-648694363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083980fa-dc53-4efd-a1b3-8bf3958a7a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:20Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccf7e0d-b3cc-4b3c-982e-bcf295e2e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ccf7e0d-b3cc-4b3c-982e-bcf295e2e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac502ed1-1d72-4cec-9694-fa4ecb146029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac502ed1-1d72-4cec-9694-fa4ecb146029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083980fa-dc53-4efd-a1b3-8bf3958a7a63', 'volume_name': 'volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43608db4-e639-4ead-9eb1-7ef6c9ce0d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43608db4-e639-4ead-9eb1-7ef6c9ce0d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd83458-b09f-4117-92c6-f0921028c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Volume 083980fa-dc53-4efd-a1b3-8bf3958a7a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63', 'volume_size': 1} Jul 07 18:14:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (75b9618e-4273-44f2-ad81-8be230808fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4673d240-59aa-483b-b090-ffa88aa49370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4673d240-59aa-483b-b090-ffa88aa49370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-5964778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28580f2d-370e-4ade-b02f-440b7a55410c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:20Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c94af85-7932-405a-a155-4967abe82631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c94af85-7932-405a-a155-4967abe82631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a229cf-601e-471d-ba5d-ce572f7872ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a229cf-601e-471d-ba5d-ce572f7872ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28580f2d-370e-4ade-b02f-440b7a55410c', 'volume_name': 'volume-28580f2d-370e-4ade-b02f-440b7a55410c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55326039-70f1-44dd-81ee-edb3705f54c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55326039-70f1-44dd-81ee-edb3705f54c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f202c635-7c76-4085-bac3-9b3804c4b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:20 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Volume 28580f2d-370e-4ade-b02f-440b7a55410c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28580f2d-370e-4ade-b02f-440b7a55410c', 'volume_size': 1} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:20 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c 1073741824" returned: 0 in 1.057s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:20 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c Jul 07 18:14:20 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:21 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c" returned: 0 in 0.707s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.885s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731177247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae54b9de-aa37-482f-96bc-89b0f5d302c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:19Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Creating volume ae54b9de-aa37-482f-96bc-89b0f5d302c7 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:21 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295d988c-1596-41b9-9c8c-6c4f3b7dd3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:21 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 1073741824 Jul 07 18:14:21 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3a6170-f844-4f5b-9eb2-e86d6e371072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:21 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Volume volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c (03a17fcb-aa96-4810-8a03-38a91ecf8a4c): created successfully Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f3a6170-f844-4f5b-9eb2-e86d6e371072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (31055b7d-2829-4087-bc26-0aea2e5ba923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-076f3244-cab1-4a53-9c0a-0a5d372a4cc7 tempest-CreateVolumesFromImageTest-1846906527 None] Created volume successfully. Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Flow 'volume_create_manager' (4964bdd5-c597-4815-b2a3-401aca82b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb012a0-90b8-4667-9a98-cbf800ef14dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb012a0-90b8-4667-9a98-cbf800ef14dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf28919-6b5c-4fec-9ca1-f2ebc5028825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc984d6ce3404d979e3d9c47403e6831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:22Z,use_quota=True,user_id='2c83c692f6824624af031dd7fc7f8a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d4480cb-c3c5-4169-aba5-39a3e24fd375),volume_type_id=2d4480cb-c3c5-4169-aba5-39a3e24fd375)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eeed5e5-c510-4d01-b36c-80e4ab9164e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eeed5e5-c510-4d01-b36c-80e4ab9164e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bbf25d-625a-486b-a206-72270258d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:22 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 1073741824" returned: 0 in 0.965s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:22 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 Jul 07 18:14:22 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3bbf25d-625a-486b-a206-72270258d547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdf28919-6b5c-4fec-9ca1-f2ebc5028825', 'volume_name': 'volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825', 'volume_size': 1, 'image_id': 'bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6efd8dd59f47f6b2295cb52ade8f2e43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc984d6ce3404d979e3d9c47403e6831', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d870d03b778cf80855d45ecaf021977650d15d7473b5d87f389b9f7953670be83e2fe33624a3fe2a1a3f30b6d9c6481a39370ac65284a809a84f5f2530f010', 'id': 'bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'created_at': datetime.datetime(2026, 7, 7, 16, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9667e8cd-1b6c-450d-b086-e18f3415ae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9667e8cd-1b6c-450d-b086-e18f3415ae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54a5444-30bf-4c5b-821d-3f99b6905358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:22 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Volume cdf28919-6b5c-4fec-9ca1-f2ebc5028825: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825', 'volume_size': 1, 'image_id': 'bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6efd8dd59f47f6b2295cb52ade8f2e43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc984d6ce3404d979e3d9c47403e6831', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d870d03b778cf80855d45ecaf021977650d15d7473b5d87f389b9f7953670be83e2fe33624a3fe2a1a3f30b6d9c6481a39370ac65284a809a84f5f2530f010', 'id': 'bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'created_at': datetime.datetime(2026, 7, 7, 16, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Trying to clone cdf28919-6b5c-4fec-9ca1-f2ebc5028825 from image bfde8172-7ef0-43c9-ac9a-7a6835ede114 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:14:22 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Image download 0.00 MB at 0.00 MB/s Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3160f25-292a-4bd5-a6f3-cf43a5622846]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:22 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD Jul 07 18:14:22 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:22 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7" returned: 0 in 0.676s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.800s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343314024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82bf345-2384-4074-a442-4bcc14098d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:18Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Creating volume b82bf345-2384-4074-a442-4bcc14098d38 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:22 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:22 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 1073741824 Jul 07 18:14:22 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63b367f-6ae9-4d2c-8cd0-ce8dd9f7841f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2995d951-85aa-4516-ace4-b5f2fc84afcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:23 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Volume volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 (ae54b9de-aa37-482f-96bc-89b0f5d302c7): created successfully Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2995d951-85aa-4516-ace4-b5f2fc84afcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (83dec949-c717-4c5f-84e5-7c9ff471fdd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:23 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-523ccf7a-335b-4407-a65a-e58f01f0c6cf tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:14:23 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:23 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD Jul 07 18:14:23 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:23 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:23 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:23 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 1073741824" returned: 0 in 0.889s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:23 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 Jul 07 18:14:23 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:24 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD" returned: 1 in 0.905s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Temporary image bfde8172-7ef0-43c9-ac9a-7a6835ede114 is fetched for user 2c83c692f6824624af031dd7fc7f8a96. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8e8185-62c1-4bac-8106-c4e30547bce1]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:24 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.735s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:24 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD Jul 07 18:14:24 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:24 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38" returned: 0 in 0.743s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.900s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-721491722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d822581-a095-4563-8035-264ba723c7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:19Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Creating volume 8d822581-a095-4563-8035-264ba723c7a2 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:24 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:24 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 1073741824 Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86005f82-4a2f-410e-9d89-e35bd485a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82bf345-2384-4074-a442-4bcc14098d38', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:24 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c21c822-1f35-44f1-8772-ad31046eb9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:24 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Volume volume-b82bf345-2384-4074-a442-4bcc14098d38 (b82bf345-2384-4074-a442-4bcc14098d38): created successfully Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c21c822-1f35-44f1-8772-ad31046eb9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (22ab72d6-32c0-4415-99f4-40c882e7d011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-fc432760-3392-4e95-9753-4b394acfa45a tempest-CreateVolumesFromImageTest-1846906527 None] Created volume successfully. Jul 07 18:14:25 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:25 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD Jul 07 18:14:25 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:25 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 1073741824" returned: 0 in 0.914s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:25 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 Jul 07 18:14:25 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:25 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:14:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:26 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2" returned: 0 in 0.662s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.380s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-648694363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083980fa-dc53-4efd-a1b3-8bf3958a7a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:20Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Creating volume 083980fa-dc53-4efd-a1b3-8bf3958a7a63 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:26 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3ab063-a3b3-4c40-95ce-7d5279c9d01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d822581-a095-4563-8035-264ba723c7a2', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:26 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 1073741824 Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bd37fc-a447-4eed-a2f9-94b56f81075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:26 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:26 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Volume volume-8d822581-a095-4563-8035-264ba723c7a2 (8d822581-a095-4563-8035-264ba723c7a2): created successfully Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bd37fc-a447-4eed-a2f9-94b56f81075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (2635bbde-9897-4545-a4a5-e9b4c1f61064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:26 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8e70a119-1b09-4f34-8984-a9bb26f39422 tempest-CreateVolumesFromImageTest-1846906527 None] Created volume successfully. Jul 07 18:14:27 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 1073741824" returned: 0 in 0.889s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:27 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 Jul 07 18:14:27 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:27 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63" returned: 0 in 0.684s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.615s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-5964778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28580f2d-370e-4ade-b02f-440b7a55410c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff85de53b4478bb07f28c95e1a0e01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:20Z,use_quota=True,user_id='3f766a7c6e4d467ca1c575dbb98c67ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Creating volume 28580f2d-370e-4ade-b02f-440b7a55410c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:27 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:27 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c 1073741824 Jul 07 18:14:27 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd83458-b09f-4117-92c6-f0921028c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc2b076-9517-4b75-bc26-aca4942c7073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:27 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Volume volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 (083980fa-dc53-4efd-a1b3-8bf3958a7a63): created successfully Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc2b076-9517-4b75-bc26-aca4942c7073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (f2cd348f-5a12-4cdb-95c7-fe7185b6e0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:27 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2f3459df-1e44-434c-ad97-fd32bc974e52 tempest-CreateVolumesFromImageTest-1846906527 None] Created volume successfully. Jul 07 18:14:28 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c 1073741824" returned: 0 in 0.861s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:28 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c Jul 07 18:14:28 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:29 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c" returned: 0 in 0.656s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.529s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f202c635-7c76-4085-bac3-9b3804c4b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28580f2d-370e-4ade-b02f-440b7a55410c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5241ac55-ee30-4179-a3cb-1d7f3f53a66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Creating offline snapshot 22e3842c-e855-4253-904b-2dc404e9e0c1 of volume fffdf48c-7d3c-4330-8139-f7d23d2965d5 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:14:29 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Volume volume-28580f2d-370e-4ade-b02f-440b7a55410c (28580f2d-370e-4ade-b02f-440b7a55410c): created successfully Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5241ac55-ee30-4179-a3cb-1d7f3f53a66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Flow 'volume_create_manager' (75b9618e-4273-44f2-ad81-8be230808fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edf232f-7bbe-4d9b-bbf3-53377241054e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cf03283f-1771-4428-a5b5-8ce2ac38a857 tempest-CreateVolumesFromImageTest-1846906527 None] Created volume successfully. Jul 07 18:14:29 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 Jul 07 18:14:29 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-28580f2d-370e-4ade-b02f-440b7a55410c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-28580f2d-370e-4ade-b02f-440b7a55410c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-quobyte-28580f2d-370e-4ade-b02f-440b7a55410c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-28580f2d-370e-4ade-b02f-440b7a55410c" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d447ac-892e-4804-a09b-6fe7cda0c46b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:30 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c Jul 07 18:14:30 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:30 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5" returned: 0 in 0.784s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:30 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 1G Jul 07 18:14:30 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:30 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c" returned: 0 in 0.762s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:30 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c Jul 07 18:14:30 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:31 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 1G" returned: 0 in 0.867s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:31 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 Jul 07 18:14:31 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:31 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-28580f2d-370e-4ade-b02f-440b7a55410c" returned: 0 in 0.692s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-28580f2d-370e-4ade-b02f-440b7a55410c" released by "delete_volume" :: held 1.501s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Created reservations ['50438401-fc8b-4699-83c9-314636d97c68', '4f9764bd-f2a1-448c-9c36-e2b6c8ba46f9', 'b60107ff-c8c0-47d8-bf41-bd2fe645fa0e', '14917cb2-e116-4d23-9792-65b26e68d69f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:31 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:31 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:31 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1" returned: 0 in 0.733s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:31 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 is being set with open permissions: ugo+rw Jul 07 18:14:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:31 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 Jul 07 18:14:31 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-083980fa-dc53-4efd-a1b3-8bf3958a7a63-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-083980fa-dc53-4efd-a1b3-8bf3958a7a63-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-quobyte-083980fa-dc53-4efd-a1b3-8bf3958a7a63" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-083980fa-dc53-4efd-a1b3-8bf3958a7a63" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:32 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.664s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:32 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Deleted volume successfully. Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb4b73e-bdaf-4547-9f9d-01ee610e2aba]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ccd9a656-fc9f-437b-b73e-7dd5d8bd1cc3 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-28580f2d-370e-4ade-b02f-440b7a55410c-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:32 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 Jul 07 18:14:32 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:32 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1" returned: 0 in 0.695s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:32 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.info Jul 07 18:14:32 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:33 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63" returned: 0 in 0.784s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:33 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63 Jul 07 18:14:33 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:33 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.info" returned: 0 in 0.658s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:33 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.info is being set with open permissions: ugo+rw Jul 07 18:14:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:33 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.info Jul 07 18:14:33 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:33 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-083980fa-dc53-4efd-a1b3-8bf3958a7a63" returned: 0 in 0.692s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:33 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-083980fa-dc53-4efd-a1b3-8bf3958a7a63" released by "delete_volume" :: held 1.537s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:33 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Created reservations ['92947090-4c9f-4146-b191-36386c6e272b', 'c9987315-8fa4-40cd-a4b7-754cfbeba3a3', '0e784e33-074c-4a47-8051-9d3c9ed5cfb2', '69cd4d54-eea9-48ff-9fa2-a1fe6dd59960'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:33 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.info" returned: 0 in 0.662s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.516s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.458s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot c839634f-3290-4331-a17c-6c893673f9ff of volume ae54b9de-aa37-482f-96bc-89b0f5d302c7 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:14:34 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cf57ac0f-3ea9-49f5-9a6f-00cd17667117 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Create snapshot completed successfully Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d22d55a-56c9-41da-9fa1-1b2f0d706d2d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:34 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:34 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:34 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 Jul 07 18:14:34 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-8d822581-a095-4563-8035-264ba723c7a2-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-8d822581-a095-4563-8035-264ba723c7a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-quobyte-8d822581-a095-4563-8035-264ba723c7a2" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-8d822581-a095-4563-8035-264ba723c7a2" acquired by "delete_volume" :: waited 0.036s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f94c8ce-4f93-40c7-ac10-94a51b27144f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:34 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.814s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:34 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:34 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Deleted volume successfully. Jul 07 18:14:34 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 Jul 07 18:14:34 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bebccd16-0ef2-48a6-80ec-9a332a0f190b tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-083980fa-dc53-4efd-a1b3-8bf3958a7a63-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:35 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7" returned: 0 in 0.971s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:35 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff 1G Jul 07 18:14:35 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (f6e6f9cf-7bef-45e2-b49d-3301b6758630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286a6dd0-4a38-4171-b856-777e99cc8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286a6dd0-4a38-4171-b856-777e99cc8be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1985759111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23365709-0903-4c74-b490-0e190af54f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:35Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f696873-09cf-4787-9670-d66058bc3f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f696873-09cf-4787-9670-d66058bc3f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194f22aa-bab1-4db9-b254-5498bdbaead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (194f22aa-bab1-4db9-b254-5498bdbaead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23365709-0903-4c74-b490-0e190af54f8a', 'volume_name': 'volume-23365709-0903-4c74-b490-0e190af54f8a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6ec956-1d9d-4a0a-be36-28cfcd91ab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6ec956-1d9d-4a0a-be36-28cfcd91ab43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf194758-ddf3-487a-a8e5-435720a09aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume 23365709-0903-4c74-b490-0e190af54f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23365709-0903-4c74-b490-0e190af54f8a', 'volume_size': 1} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (29706c3c-e619-44cc-9f02-de1acf08d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfd2ec3-9b60-4b8d-9e43-cd0a4a883015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfd2ec3-9b60-4b8d-9e43-cd0a4a883015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666818879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:36Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b12564-7907-42f0-a126-223fe396d503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b12564-7907-42f0-a126-223fe396d503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cd74b6-356a-4109-84a1-5970077c2e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cd74b6-356a-4109-84a1-5970077c2e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b', 'volume_name': 'volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf84426-c924-47a2-bdb7-b6f9f26fc95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecf84426-c924-47a2-bdb7-b6f9f26fc95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183a1e08-185b-44d1-843d-38976ebaa20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:35 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b', 'volume_size': 1} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:35 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2" returned: 0 in 1.002s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:35 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2 Jul 07 18:14:35 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:36 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (1c4a1dd8-8342-43f6-bf50-a535e0a68f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59ae800-1f07-4097-b4bd-6800d9be5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff 1G" returned: 0 in 1.138s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59ae800-1f07-4097-b4bd-6800d9be5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1300029707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd442aa-cfaf-4d3d-8803-e4f443f63c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:36Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:36 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567db434-d297-4138-b515-a971edfa91ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567db434-d297-4138-b515-a971edfa91ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219e6109-c063-4b5d-a0ec-0a9a214507b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219e6109-c063-4b5d-a0ec-0a9a214507b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd442aa-cfaf-4d3d-8803-e4f443f63c25', 'volume_name': 'volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29641e9-479c-4728-bdca-9a3e52759464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d29641e9-479c-4728-bdca-9a3e52759464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd5cf63-008a-4604-b086-0085c2c883fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume 7cd442aa-cfaf-4d3d-8803-e4f443f63c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25', 'volume_size': 1} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (4db85838-8c3e-4188-97bc-5562da921c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139d287b-890a-4bed-b524-66826e4c57b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139d287b-890a-4bed-b524-66826e4c57b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792750260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d70032-097c-433f-ad9d-b23f39f81f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:36Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd58af6c-7b37-4f81-8e19-13914a58e4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd58af6c-7b37-4f81-8e19-13914a58e4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2460c4-f67d-4610-93b8-1201b46c5158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2460c4-f67d-4610-93b8-1201b46c5158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d70032-097c-433f-ad9d-b23f39f81f2b', 'volume_name': 'volume-21d70032-097c-433f-ad9d-b23f39f81f2b', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f461df-222a-411a-8a60-105c0072f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f461df-222a-411a-8a60-105c0072f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:36 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53369101-645c-402c-a74e-22bf19fb72ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:36 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume 21d70032-097c-433f-ad9d-b23f39f81f2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d70032-097c-433f-ad9d-b23f39f81f2b', 'volume_size': 1} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8d822581-a095-4563-8035-264ba723c7a2" returned: 0 in 0.869s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-8d822581-a095-4563-8035-264ba723c7a2" released by "delete_volume" :: held 1.936s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Created reservations ['90a8725e-0b79-4c0a-b0f2-fd234309e2c1', 'ec727ef7-6f3f-4d03-bbdc-97ac1e53a232', 'bd135c8b-268f-4274-92a4-f9f83c10f89d', '5e62effa-3b51-47f9-b7f5-d08e787c344b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:36 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:36 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-03a17fcb-aa96-4810-8a03-38a91ecf8a4c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-03a17fcb-aa96-4810-8a03-38a91ecf8a4c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (612ad088-f16f-497d-bf67-0517bfc56237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccc838c-6932-4af1-9b9b-b97fa99cdc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccc838c-6932-4af1-9b9b-b97fa99cdc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1968159806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00a67c5-5aca-4c0f-8a51-52028d7fd886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:37Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8e7323-b390-4b81-9bf2-7e083ad79bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8e7323-b390-4b81-9bf2-7e083ad79bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc96a51d-2ff5-489c-9654-e4f59f6857f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:37 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc96a51d-2ff5-489c-9654-e4f59f6857f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00a67c5-5aca-4c0f-8a51-52028d7fd886', 'volume_name': 'volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae36fc0d-b6da-4d32-8716-2802fffb181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae36fc0d-b6da-4d32-8716-2802fffb181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7a047d-c12e-432c-9d92-17013c1e1304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:37 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume c00a67c5-5aca-4c0f-8a51-52028d7fd886: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886', 'volume_size': 1} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff" returned: 0 in 0.969s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:37 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff is being set with open permissions: ugo+rw Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:37 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff Jul 07 18:14:37 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-quobyte-03a17fcb-aa96-4810-8a03-38a91ecf8a4c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-03a17fcb-aa96-4810-8a03-38a91ecf8a4c" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ffc8f9-d18f-4363-954d-5aa0dae9ad59]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:37 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c Jul 07 18:14:37 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:37 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.770s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Deleted volume successfully. Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9a33ec8a-2a77-47c0-98c6-b9b5881d0044 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-8d822581-a095-4563-8035-264ba723c7a2-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:37 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff" returned: 0 in 0.691s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:37 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.info Jul 07 18:14:37 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:38 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c" returned: 0 in 0.805s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:38 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c Jul 07 18:14:38 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:38 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.info" returned: 0 in 0.688s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:38 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.info is being set with open permissions: ugo+rw Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:38 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.info Jul 07 18:14:38 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:38 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-03a17fcb-aa96-4810-8a03-38a91ecf8a4c" returned: 0 in 0.673s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-03a17fcb-aa96-4810-8a03-38a91ecf8a4c" released by "delete_volume" :: held 1.523s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Created reservations ['21a9d7ef-fd3a-4a4d-85f9-a6fcd04ce490', 'ae918ebf-1285-496c-bc9c-1a101eb928be', '76d78ca9-d0ea-4bc9-b9d0-bcc5ff95114d', '9e9f45cd-d9e5-4b8f-8e63-9986334b4ca3'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:38 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:38 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-b82bf345-2384-4074-a442-4bcc14098d38-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-b82bf345-2384-4074-a442-4bcc14098d38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:39 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.info" returned: 0 in 0.717s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.294s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.319s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf28919-6b5c-4fec-9ca1-f2ebc5028825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc984d6ce3404d979e3d9c47403e6831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:22Z,use_quota=True,user_id='2c83c692f6824624af031dd7fc7f8a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d4480cb-c3c5-4169-aba5-39a3e24fd375),volume_type_id=2d4480cb-c3c5-4169-aba5-39a3e24fd375)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Creating volume cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:39 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:39 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 1073741824 Jul 07 18:14:39 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "cinder-quobyte-b82bf345-2384-4074-a442-4bcc14098d38" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:39 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ccbe409c-9450-43f8-b507-401858c85881 tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-b82bf345-2384-4074-a442-4bcc14098d38" acquired by "delete_volume" :: waited 0.027s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff34490-4f45-4eb2-8a1b-ba6783f17a1f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:39 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 Jul 07 18:14:39 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:39 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.704s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:39 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Deleted volume successfully. Jul 07 18:14:39 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6b7b927d-175d-480e-b9d5-d62ccca1fa4a tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-03a17fcb-aa96-4810-8a03-38a91ecf8a4c-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-c839634f-3290-4331-a17c-6c893673f9ff-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-c839634f-3290-4331-a17c-6c893673f9ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:40 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-ae54b9de-aa37-482f-96bc-89b0f5d302c7" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 1073741824" returned: 0 in 0.907s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:40 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38" returned: 0 in 0.831s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-ae54b9de-aa37-482f-96bc-89b0f5d302c7" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-c839634f-3290-4331-a17c-6c893673f9ff" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:40 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38 Jul 07 18:14:40 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-c839634f-3290-4331-a17c-6c893673f9ff" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot c839634f-3290-4331-a17c-6c893673f9ff of volume ae54b9de-aa37-482f-96bc-89b0f5d302c7 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31ef71-c28b-46ba-bf52-e6c10c2de67d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:40 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 Jul 07 18:14:40 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:40 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff Jul 07 18:14:40 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:40 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b82bf345-2384-4074-a442-4bcc14098d38" returned: 0 in 0.724s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:40 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-quobyte-b82bf345-2384-4074-a442-4bcc14098d38" released by "delete_volume" :: held 1.606s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" returned: 0 in 0.691s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.657s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1985759111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23365709-0903-4c74-b490-0e190af54f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:35Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Creating volume 23365709-0903-4c74-b490-0e190af54f8a {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:41 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:41 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a 1073741824 Jul 07 18:14:41 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Attempting download of bfde8172-7ef0-43c9-ac9a-7a6835ede114 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'metadata': {}}])) to volume cdf28919-6b5c-4fec-9ca1-f2ebc5028825. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Created reservations ['6b6efdcf-3762-4913-b01b-b726608e0453', 'dd6d39b0-baf6-4ced-b20f-4d0bc7671f50', 'dc24612f-5092-4693-a735-98b897486171', '9bd613fe-2e1f-4867-8271-48408a3deb1e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f965a0-987e-40dd-b3af-1be954359a43]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfde8172-7ef0-43c9-ac9a-7a6835ede114_58s5_vwy {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:41 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:41 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff" returned: 0 in 0.953s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:14:41 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdad03e3-23bf-467d-811e-5a82bf24cd46]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:41 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfde8172-7ef0-43c9-ac9a-7a6835ede114_58s5_vwy Jul 07 18:14:41 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:41 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 Jul 07 18:14:41 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:42 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a 1073741824" returned: 0 in 1.050s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:42 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a Jul 07 18:14:42 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:42 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfde8172-7ef0-43c9-ac9a-7a6835ede114_58s5_vwy" returned: 0 in 1.150s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfde8172-7ef0-43c9-ac9a-7a6835ede114_58s5_vwy {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:42 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.177s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:42 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Deleted volume successfully. Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bffab74d-9c19-4d38-8424-6a60f5bd5a96 tempest-CreateVolumesFromImageTest-1846906527 None] Lock "cinder-b82bf345-2384-4074-a442-4bcc14098d38-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:42 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfde8172-7ef0-43c9-ac9a-7a6835ede114_58s5_vwy Jul 07 18:14:42 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:42 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7" returned: 0 in 1.201s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:42 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff Jul 07 18:14:42 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:43 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a" returned: 0 in 0.934s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.303s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666818879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:36Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Creating volume c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:43 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf194758-ddf3-487a-a8e5-435720a09aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23365709-0903-4c74-b490-0e190af54f8a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55451d85-336f-4850-9fe4-35df8e3380e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:43 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b 1073741824 Jul 07 18:14:43 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:43 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume volume-23365709-0903-4c74-b490-0e190af54f8a (23365709-0903-4c74-b490-0e190af54f8a): created successfully Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55451d85-336f-4850-9fe4-35df8e3380e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (f6e6f9cf-7bef-45e2-b49d-3301b6758630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bd0ff39e-c136-4a78-bc41-d6294781a01e tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created volume successfully. Jul 07 18:14:43 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfde8172-7ef0-43c9-ac9a-7a6835ede114_58s5_vwy" returned: 1 in 1.093s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfde8172-7ef0-43c9-ac9a-7a6835ede114_58s5_vwy' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96b2fbb-f87f-4e5d-8134-02ed54867850]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:43 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff" returned: 0 in 0.998s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:43 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff Jul 07 18:14:43 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:43 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD Jul 07 18:14:43 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:44 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b 1073741824" returned: 0 in 1.126s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:44 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b Jul 07 18:14:44 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:44 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD" returned: 0 in 0.947s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:44 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7.c839634f-3290-4331-a17c-6c893673f9ff" returned: 0 in 0.829s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-c839634f-3290-4331-a17c-6c893673f9ff" released by "_delete_snapshot" :: held 4.166s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-ae54b9de-aa37-482f-96bc-89b0f5d302c7" released by "delete_snapshot" :: held 4.199s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:44 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD Jul 07 18:14:44 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Created reservations ['408ccbdc-479a-49ef-b924-2aafa8b931b2', 'e06ea468-0d59-4679-96ce-518d143b94f1', '6a15ef95-6fbc-416b-988b-f09a6a276b98', 'cbbb883d-c8f6-4479-a324-9edc6e0cc099'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:14:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9cfb2c2a-b3dd-4f92-88ac-2f57f1dd3762 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-c839634f-3290-4331-a17c-6c893673f9ff-delete_snapshot" released by "delete_snapshot" :: held 4.473s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:45 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b" returned: 0 in 0.729s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.772s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1300029707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd442aa-cfaf-4d3d-8803-e4f443f63c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:36Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Creating volume 7cd442aa-cfaf-4d3d-8803-e4f443f63c25 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:45 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183a1e08-185b-44d1-843d-38976ebaa20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 1073741824 Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6ca728-153c-4f47-a554-ad1f75d359dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:45 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b (c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b): created successfully Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6ca728-153c-4f47-a554-ad1f75d359dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (29706c3c-e619-44cc-9f02-de1acf08d0df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-68cb1c9d-f7d6-4f9e-b156-3750d81b66d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created volume successfully. Jul 07 18:14:45 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD" returned: 1 in 0.931s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] bfde8172-7ef0-43c9-ac9a-7a6835ede114 was raw, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:45 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 Jul 07 18:14:45 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-ae54b9de-aa37-482f-96bc-89b0f5d302c7-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-ae54b9de-aa37-482f-96bc-89b0f5d302c7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-ae54b9de-aa37-482f-96bc-89b0f5d302c7" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-ae54b9de-aa37-482f-96bc-89b0f5d302c7" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e006df-0ba1-49d6-92e5-d3e744b09fc1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (9789f12e-1a77-415f-af06-53fd4e9d78d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefb3a62-39bc-4135-8da2-8dbb5e962eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefb3a62-39bc-4135-8da2-8dbb5e962eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2002521931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582d4bcd-e976-4820-8183-1566e3113d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:46Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36845ad4-4c78-41c8-8b70-c25f4b6e654c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36845ad4-4c78-41c8-8b70-c25f4b6e654c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d66d898-921e-401e-a9a8-266dc691a5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d66d898-921e-401e-a9a8-266dc691a5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '582d4bcd-e976-4820-8183-1566e3113d7c', 'volume_name': 'volume-582d4bcd-e976-4820-8183-1566e3113d7c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 Jul 07 18:14:45 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6cd698-a767-4d34-b568-75ee4071f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6cd698-a767-4d34-b568-75ee4071f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5015bf4-4d17-48c0-8c3f-0b05e448d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:46 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume 582d4bcd-e976-4820-8183-1566e3113d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-582d4bcd-e976-4820-8183-1566e3113d7c', 'volume_size': 1} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:46 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 1073741824" returned: 0 in 1.039s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:46 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 Jul 07 18:14:46 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:46 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" returned: 0 in 0.982s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfde8172-7ef0-43c9-ac9a-7a6835ede114_ofzevnbmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:14:46 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:46 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 1G Jul 07 18:14:46 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:46 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7" returned: 0 in 0.861s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:46 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7 Jul 07 18:14:46 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:46 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25" returned: 0 in 0.726s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.180s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792750260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d70032-097c-433f-ad9d-b23f39f81f2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:36Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Creating volume 21d70032-097c-433f-ad9d-b23f39f81f2b {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:46 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd5cf63-008a-4604-b086-0085c2c883fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:46 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b 1073741824 Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b822186-53da-4186-8fb0-e150d7d80601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:46 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:46 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 (7cd442aa-cfaf-4d3d-8803-e4f443f63c25): created successfully Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b822186-53da-4186-8fb0-e150d7d80601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (1c4a1dd8-8342-43f6-bf50-a535e0a68f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:46 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8fcc2f66-7f27-4f1d-be80-2ad81c139b66 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created volume successfully. Jul 07 18:14:47 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 1G" returned: 0 in 0.816s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[96711e66-1514-452a-9c8a-35a89a45029c]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:47 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 Jul 07 18:14:47 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:47 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ae54b9de-aa37-482f-96bc-89b0f5d302c7" returned: 0 in 0.734s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-ae54b9de-aa37-482f-96bc-89b0f5d302c7" released by "delete_volume" :: held 1.681s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Created reservations ['d45468a2-e514-49cf-be84-d39077714c9f', '5d080ac4-75b9-4902-b299-98ce4637ae69', '17dfeaa7-5e15-4a57-afe1-d8a668e5a384', 'cf55c08e-f435-4b10-9b34-00ea586dd42f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:47 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:47 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:47 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b 1073741824" returned: 0 in 0.962s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:47 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b Jul 07 18:14:47 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:47 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" returned: 0 in 0.859s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:48 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 Jul 07 18:14:48 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:48 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.893s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (09de34a8-d0d8-44f4-953d-22a417fde12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35b67b0-a0e7-464e-beba-3f8a121b3958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba62fbc6-3de5-4b95-b583-f1be18ba2e67 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-ae54b9de-aa37-482f-96bc-89b0f5d302c7-delete_volume" released by "delete_volume" :: held 2.902s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e35b67b0-a0e7-464e-beba-3f8a121b3958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109131499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99945ece-5b07-4669-8d3d-97139747e9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:48Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfbd6e5-ed83-4e68-ac60-33f6edd1f00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfbd6e5-ed83-4e68-ac60-33f6edd1f00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908eaf9a-5785-4e85-9275-275cba38ff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908eaf9a-5785-4e85-9275-275cba38ff05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99945ece-5b07-4669-8d3d-97139747e9d2', 'volume_name': 'volume-99945ece-5b07-4669-8d3d-97139747e9d2', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c31858-eb06-43ed-bd2b-7f5ad6d5db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c31858-eb06-43ed-bd2b-7f5ad6d5db4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48df8dc1-49a1-44a5-a81c-a30479000236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:48 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Volume 99945ece-5b07-4669-8d3d-97139747e9d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99945ece-5b07-4669-8d3d-97139747e9d2', 'volume_size': 1} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:48 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b" returned: 0 in 0.837s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.567s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1968159806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00a67c5-5aca-4c0f-8a51-52028d7fd886,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdcc979b89446b6b1ef7aa895775c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:37Z,use_quota=True,user_id='48e2321898614dd4b14f4d041210ce9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Creating volume c00a67c5-5aca-4c0f-8a51-52028d7fd886 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:48 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:48 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 1073741824 Jul 07 18:14:48 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53369101-645c-402c-a74e-22bf19fb72ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d70032-097c-433f-ad9d-b23f39f81f2b', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527ad4e0-fd49-42a3-a401-4b5ca4ebfec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:48 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume volume-21d70032-097c-433f-ad9d-b23f39f81f2b (21d70032-097c-433f-ad9d-b23f39f81f2b): created successfully Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527ad4e0-fd49-42a3-a401-4b5ca4ebfec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (4db85838-8c3e-4188-97bc-5562da921c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d5204ecd-5552-490a-b052-fdf7a58e6aae tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created volume successfully. Jul 07 18:14:48 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" returned: 1 in 0.901s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Downloaded image bfde8172-7ef0-43c9-ac9a-7a6835ede114 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'metadata': {}}])) to volume cdf28919-6b5c-4fec-9ca1-f2ebc5028825 successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Temporary image bfde8172-7ef0-43c9-ac9a-7a6835ede114 for user 2c83c692f6824624af031dd7fc7f8a96 is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Marking volume cdf28919-6b5c-4fec-9ca1-f2ebc5028825 as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Copying metadata from image bfde8172-7ef0-43c9-ac9a-7a6835ede114 to cdf28919-6b5c-4fec-9ca1-f2ebc5028825. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Creating volume glance metadata for volume cdf28919-6b5c-4fec-9ca1-f2ebc5028825 backed by image bfde8172-7ef0-43c9-ac9a-7a6835ede114 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6efd8dd59f47f6b2295cb52ade8f2e43', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:14:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54a5444-30bf-4c5b-821d-3f99b6905358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825', 'volume_size': 1, 'image_id': 'bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6efd8dd59f47f6b2295cb52ade8f2e43', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cc984d6ce3404d979e3d9c47403e6831', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3d870d03b778cf80855d45ecaf021977650d15d7473b5d87f389b9f7953670be83e2fe33624a3fe2a1a3f30b6d9c6481a39370ac65284a809a84f5f2530f010', 'id': 'bfde8172-7ef0-43c9-ac9a-7a6835ede114', 'created_at': datetime.datetime(2026, 7, 7, 16, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfde8172-7ef0-43c9-ac9a-7a6835ede114/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa27a67-7e90-47f6-bb12-563e40e740c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:49 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Volume volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 (cdf28919-6b5c-4fec-9ca1-f2ebc5028825): created successfully Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa27a67-7e90-47f6-bb12-563e40e740c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Flow 'volume_create_manager' (4964bdd5-c597-4815-b2a3-401aca82b897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:49 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8d9d91e6-6bf9-41da-b894-850f3e1ce52e tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Created volume successfully. Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Acquiring lock "cinder-cdf28919-6b5c-4fec-9ca1-f2ebc5028825-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "cinder-cdf28919-6b5c-4fec-9ca1-f2ebc5028825-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Acquiring lock "cinder-quobyte-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "cinder-quobyte-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad599f3a-dd44-4872-b6aa-04fab62f83b4]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:49 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 Jul 07 18:14:49 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:49 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 1073741824" returned: 0 in 0.875s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:49 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 Jul 07 18:14:49 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:50 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" returned: 0 in 0.803s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:50 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 Jul 07 18:14:50 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:50 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886" returned: 0 in 0.680s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.312s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2002521931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582d4bcd-e976-4820-8183-1566e3113d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:46Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Creating volume 582d4bcd-e976-4820-8183-1566e3113d7c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:50 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:50 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c 1073741824 Jul 07 18:14:50 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7a047d-c12e-432c-9d92-17013c1e1304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c5593f-24e8-49ef-a5ab-8fc305ec7efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:50 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Volume volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 (c00a67c5-5aca-4c0f-8a51-52028d7fd886): created successfully Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56c5593f-24e8-49ef-a5ab-8fc305ec7efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Flow 'volume_create_manager' (612ad088-f16f-497d-bf67-0517bfc56237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-43fc1caa-5546-4fa7-998e-07aeea457989 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created volume successfully. Jul 07 18:14:50 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" returned: 1 in 0.751s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:14:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:50 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825 Jul 07 18:14:50 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:51 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c 1073741824" returned: 0 in 0.838s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:51 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c Jul 07 18:14:51 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-c00a67c5-5aca-4c0f-8a51-52028d7fd886-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-c00a67c5-5aca-4c0f-8a51-52028d7fd886-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-quobyte-c00a67c5-5aca-4c0f-8a51-52028d7fd886" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-c00a67c5-5aca-4c0f-8a51-52028d7fd886" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e0108-5676-49d1-ad97-bb869deb6dcb]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:51 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" returned: 0 in 0.737s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "cinder-quobyte-cdf28919-6b5c-4fec-9ca1-f2ebc5028825" released by "delete_volume" :: held 2.360s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Created reservations ['27f8b2b6-2c04-4f9a-889d-36cd36d954ab', '2b56f717-094b-4e65-ac24-b799e78ff555', '81718ebe-2ba8-4037-8c09-3fe12836e464', '26bbd46c-9975-4c17-bd7f-fa9f05fe70b5'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:51 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 Jul 07 18:14:51 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:51 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:51 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:51 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c" returned: 0 in 0.670s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.267s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1109131499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99945ece-5b07-4669-8d3d-97139747e9d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:48Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Creating volume 99945ece-5b07-4669-8d3d-97139747e9d2 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:51 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:51 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 1073741824 Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5015bf4-4d17-48c0-8c3f-0b05e448d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582d4bcd-e976-4820-8183-1566e3113d7c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:51 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf119faa-7060-4957-b03a-5b70c58b80e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:51 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume volume-582d4bcd-e976-4820-8183-1566e3113d7c (582d4bcd-e976-4820-8183-1566e3113d7c): created successfully Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf119faa-7060-4957-b03a-5b70c58b80e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:51 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (9789f12e-1a77-415f-af06-53fd4e9d78d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8aca065d-8c8b-4bf3-8593-9bf8292981a0 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created volume successfully. Jul 07 18:14:52 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886" returned: 0 in 0.833s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:52 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886 Jul 07 18:14:52 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:52 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.912s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:52 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:52 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Deleted volume successfully. Jul 07 18:14:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42770fc8-f5ef-4d68-9bed-d6d413178301 tempest-VolumeAndVolumeTypeFromImageTest-575035722 None] Lock "cinder-cdf28919-6b5c-4fec-9ca1-f2ebc5028825-delete_volume" released by "delete_volume" :: held 3.525s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (a6b71c10-a5b8-462a-802d-f98edb7ff8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c00e8c-88a4-4689-894a-0ebdb98ca094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c00e8c-88a4-4689-894a-0ebdb98ca094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042999001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5d4a6d-aad5-4623-b9de-aab9d248b727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:53Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370f2882-4353-4567-8dd5-3cf6c58bcff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370f2882-4353-4567-8dd5-3cf6c58bcff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc7c56d-8250-4508-9168-47beac7e1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc7c56d-8250-4508-9168-47beac7e1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5d4a6d-aad5-4623-b9de-aab9d248b727', 'volume_name': 'volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4ec3b8-2a65-457b-9430-aabd81fb4c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4ec3b8-2a65-457b-9430-aabd81fb4c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f0049c-7b17-474d-9860-0b08fc336fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume 2e5d4a6d-aad5-4623-b9de-aab9d248b727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727', 'volume_size': 1} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 1073741824" returned: 0 in 1.279s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:53 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 Jul 07 18:14:53 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:53 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (e16b0958-f4a8-4a1b-81af-b434a3c430bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801e6a19-c466-4018-b181-5e6cfd22fc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c00a67c5-5aca-4c0f-8a51-52028d7fd886" returned: 0 in 1.140s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (801e6a19-c466-4018-b181-5e6cfd22fc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316973403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:53Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f84637c-62eb-45db-a91e-ebdced7cefeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f84637c-62eb-45db-a91e-ebdced7cefeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a397b5-b00f-4632-94ef-a0a74459631f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a397b5-b00f-4632-94ef-a0a74459631f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9', 'volume_name': 'volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7643f5-013d-4021-8612-f51b1810a1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7643f5-013d-4021-8612-f51b1810a1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad0278a-8834-4ca6-a954-7ac8861aa0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume 8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9', 'volume_size': 1} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-c00a67c5-5aca-4c0f-8a51-52028d7fd886" released by "delete_volume" :: held 2.062s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created reservations ['d208647f-a831-4816-8c2e-6fc880db6372', '5a82c08d-df87-4fd8-a6f3-62b0247dad11', '6c5e577d-eb85-454c-a18d-01554e6bb778', 'c855aa10-4004-415e-a4c1-7cbc3ad7ad88'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:54 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:54 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-21d70032-097c-433f-ad9d-b23f39f81f2b-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-21d70032-097c-433f-ad9d-b23f39f81f2b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-quobyte-21d70032-097c-433f-ad9d-b23f39f81f2b" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-21d70032-097c-433f-ad9d-b23f39f81f2b" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25790c0-c11e-4e06-a9ec-8fc4c8d1a19a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:54 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2" returned: 0 in 1.071s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (2394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.111s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2042999001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5d4a6d-aad5-4623-b9de-aab9d248b727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:53Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Creating volume 2e5d4a6d-aad5-4623-b9de-aab9d248b727 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:54 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:54 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 1073741824 Jul 07 18:14:54 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (1c361204-6a4e-4a26-b986-7d34e051f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c2a16c-a018-47f0-9223-1f462da545b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48df8dc1-49a1-44a5-a81c-a30479000236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99945ece-5b07-4669-8d3d-97139747e9d2', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71b2b6c-b93c-49ce-8fee-bd059aa5be80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:54 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c2a16c-a018-47f0-9223-1f462da545b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111056337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a1ed83-6c8d-48b7-a769-e682a237a9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:54Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:54 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37df5ff1-18fb-4537-830f-f34e63ff97e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37df5ff1-18fb-4537-830f-f34e63ff97e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b42f4d-b755-48d8-b244-41c9c7fee50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b42f4d-b755-48d8-b244-41c9c7fee50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30a1ed83-6c8d-48b7-a769-e682a237a9a6', 'volume_name': 'volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e241f1fb-fbef-46c2-bf0d-711d976f17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e241f1fb-fbef-46c2-bf0d-711d976f17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2606764b-cc86-4f4c-9cb6-2c5e4fc233e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:54 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume 30a1ed83-6c8d-48b7-a769-e682a237a9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6', 'volume_size': 1} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:54 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Volume volume-99945ece-5b07-4669-8d3d-97139747e9d2 (99945ece-5b07-4669-8d3d-97139747e9d2): created successfully Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71b2b6c-b93c-49ce-8fee-bd059aa5be80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (09de34a8-d0d8-44f4-953d-22a417fde12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5226e856-d6b4-4950-9fe6-9d8920bb8a45 tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (1b021c05-dcb2-45ec-8134-b9fdf13e9715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085ea1af-caf4-47ce-b1f8-7a13250131f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.029s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085ea1af-caf4-47ce-b1f8-7a13250131f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-454697682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66cc747-8d51-44a4-a7fc-c04f2f8a31d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:55Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9d2eaf-e5d5-40be-914d-e220c5183e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9d2eaf-e5d5-40be-914d-e220c5183e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20caa7f1-5e59-4d87-a8d4-7fe37dddb349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20caa7f1-5e59-4d87-a8d4-7fe37dddb349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66cc747-8d51-44a4-a7fc-c04f2f8a31d5', 'volume_name': 'volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fef503-21d7-4677-8aad-f521bafea8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fef503-21d7-4677-8aad-f521bafea8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22406f8-815a-4f00-ab05-b1bda9103d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume d66cc747-8d51-44a4-a7fc-c04f2f8a31d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5', 'volume_size': 1} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Deleted volume successfully. Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-42549765-28bd-415e-a501-31ba2244ff3c tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-c00a67c5-5aca-4c0f-8a51-52028d7fd886-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (58c907f1-a342-4f31-bbc3-cf32e383e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e183ef-a832-415b-b473-81d35fd043f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e183ef-a832-415b-b473-81d35fd043f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-538357660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c493581-981d-4e5d-88c4-61f4cf3bc0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:55Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d213f5-e469-440d-8d7a-45b485a39329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3d213f5-e469-440d-8d7a-45b485a39329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748c03ad-8ba1-48fd-941d-2c60db0e89a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748c03ad-8ba1-48fd-941d-2c60db0e89a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c493581-981d-4e5d-88c4-61f4cf3bc0eb', 'volume_name': 'volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45149598-2683-44aa-8dbc-ab37bda2bc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45149598-2683-44aa-8dbc-ab37bda2bc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf6d05d-70e5-4541-9f9b-484d911286ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:55 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume 6c493581-981d-4e5d-88c4-61f4cf3bc0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb', 'volume_size': 1} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b" returned: 0 in 1.469s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:55 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b Jul 07 18:14:55 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:55 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 1073741824" returned: 0 in 1.571s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:55 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 Jul 07 18:14:55 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:56 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-21d70032-097c-433f-ad9d-b23f39f81f2b" returned: 0 in 0.764s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-21d70032-097c-433f-ad9d-b23f39f81f2b" released by "delete_volume" :: held 2.302s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created reservations ['bda92258-caed-4266-afe3-f2ca37b2f07b', '5edd1b5e-2e0f-4d83-b3d1-701aa784de5a', '114c03f2-b1d3-439f-bb5c-2230864c898d', 'b6fc469a-8498-484e-a9a0-4c362ce4723f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:56 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:56 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:56 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727" returned: 0 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] <== create_volume: return (2504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.508s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.108s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1316973403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:53Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Creating volume 8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:56 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:56 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 1073741824 Jul 07 18:14:56 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f0049c-7b17-474d-9860-0b08fc336fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d111ee-ec6d-4492-bd35-34b14f833aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:56 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 (2e5d4a6d-aad5-4623-b9de-aab9d248b727): created successfully Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d111ee-ec6d-4492-bd35-34b14f833aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (a6b71c10-a5b8-462a-802d-f98edb7ff8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ddc98dcb-5e6c-4936-94fd-f5552eda2ba9 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created volume successfully. Jul 07 18:14:57 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.774s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Deleted volume successfully. Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0c77438f-9115-42f1-a3fc-a574b0e1f4c9 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-21d70032-097c-433f-ad9d-b23f39f81f2b-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-7cd442aa-cfaf-4d3d-8803-e4f443f63c25-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-7cd442aa-cfaf-4d3d-8803-e4f443f63c25-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-quobyte-7cd442aa-cfaf-4d3d-8803-e4f443f63c25" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-7cd442aa-cfaf-4d3d-8803-e4f443f63c25" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0b128-febc-4fe6-b2c2-7b6c40261c16]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:57 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 Jul 07 18:14:57 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:57 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 1073741824" returned: 0 in 1.095s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:57 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 Jul 07 18:14:57 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:58 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25" returned: 0 in 0.862s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:58 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25 Jul 07 18:14:58 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:58 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9" returned: 0 in 0.759s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.200s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111056337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30a1ed83-6c8d-48b7-a769-e682a237a9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:54Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Creating volume 30a1ed83-6c8d-48b7-a769-e682a237a9a6 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:58 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:58 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 1073741824 Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad0278a-8834-4ca6-a954-7ac8861aa0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:58 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d327be-29c6-439d-8600-f987906e61cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:58 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 (8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9): created successfully Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d327be-29c6-439d-8600-f987906e61cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (e16b0958-f4a8-4a1b-81af-b434a3c430bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b75a4ead-d0b9-46c6-bc12-87d4945c7a7a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created volume successfully. Jul 07 18:14:59 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7cd442aa-cfaf-4d3d-8803-e4f443f63c25" returned: 0 in 0.728s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-7cd442aa-cfaf-4d3d-8803-e4f443f63c25" released by "delete_volume" :: held 1.639s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created reservations ['71cde814-25d6-4544-b63c-ecb166bfbb6e', 'e36574f4-ca07-40cb-b380-d1bfd6b0b582', '9fa680cc-73a9-41ce-b649-23c832fda9e8', '28cb3e10-d755-44f6-863b-4f347ec7310d'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:59 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:14:59 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:59 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 1073741824" returned: 0 in 0.959s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:59 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 Jul 07 18:14:59 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-quobyte-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f75fed7-5ae6-4dd2-97a6-ea4750e9cefc]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:00 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b Jul 07 18:15:00 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:00 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.799s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Deleted volume successfully. Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6749c9fe-1388-4925-96e6-fd4c3c0eb4a6 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-7cd442aa-cfaf-4d3d-8803-e4f443f63c25-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:00 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6" returned: 0 in 0.728s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.327s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-454697682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66cc747-8d51-44a4-a7fc-c04f2f8a31d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:55Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Creating volume d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:00 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2606764b-cc86-4f4c-9cb6-2c5e4fc233e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d980d058-4fbb-46e1-a129-6c6082e95181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:00 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 1073741824 Jul 07 18:15:00 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:00 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 (30a1ed83-6c8d-48b7-a769-e682a237a9a6): created successfully Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d980d058-4fbb-46e1-a129-6c6082e95181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (1c361204-6a4e-4a26-b986-7d34e051f78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ecd9ed86-65ea-4710-a8ab-fe7e9391d48a tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created volume successfully. Jul 07 18:15:00 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b" returned: 0 in 0.887s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:00 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b Jul 07 18:15:00 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:01 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 1073741824" returned: 0 in 1.057s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:01 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b" returned: 0 in 0.727s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:01 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 Jul 07 18:15:01 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b" released by "delete_volume" :: held 1.677s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created reservations ['2f96c34b-aabf-40ec-a1d2-11509fd0ec40', 'ea8c63f1-fa3e-4432-afac-87ae1026504b', '9535d8c1-a16b-4c96-8e9c-d8c2d78cc5f6', 'd27e2629-4c01-402a-815d-7c912cefb7d1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Flow 'volume_create_manager' (f048f8fc-4ecd-412b-a7c8-07abe418d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5e3eb5-fe70-496a-a007-a4ed6a9e08cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5e3eb5-fe70-496a-a007-a4ed6a9e08cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcb8d88-dea5-49be-9203-52a4a8c1635c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a0103d3edb44d5a27976f33273aac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:02Z,use_quota=True,user_id='f1879dd8066e4855bdb42889ecf013bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea5d971-e9e4-4296-99b6-3c2ba066efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ea5d971-e9e4-4296-99b6-3c2ba066efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85615c9-420f-4b07-9fb6-5ec5acbced6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.image.glance [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Creating Keystone auth plugin from conf {{(pid=87228) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:01 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:01 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85615c9-420f-4b07-9fb6-5ec5acbced6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'edcb8d88-dea5-49be-9203-52a4a8c1635c', 'volume_name': 'volume-edcb8d88-dea5-49be-9203-52a4a8c1635c', 'volume_size': 1, 'image_id': '99e9b231-a220-4153-93fe-0134e26dc279', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99e9b231-a220-4153-93fe-0134e26dc279', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '982af694c44f06ae1dd23855e716f9a9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3a0103d3edb44d5a27976f33273aac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '835bf798230b619dca1731f118ae31a337f30955d2b436916dc266587d8b5f6a816f99fa8b9d2e16f6f6be2432553e5b5cdd3e8c93c98a07cd524066ccb5246c', 'id': '99e9b231-a220-4153-93fe-0134e26dc279', 'created_at': datetime.datetime(2026, 7, 7, 16, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99e9b231-a220-4153-93fe-0134e26dc279/file', 'properties': {}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853563da-95ce-406f-a1f5-5eff6b670ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853563da-95ce-406f-a1f5-5eff6b670ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e67a130-7fc9-485f-b93d-ae125720f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:02 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Volume edcb8d88-dea5-49be-9203-52a4a8c1635c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-edcb8d88-dea5-49be-9203-52a4a8c1635c', 'volume_size': 1, 'image_id': '99e9b231-a220-4153-93fe-0134e26dc279', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99e9b231-a220-4153-93fe-0134e26dc279', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '982af694c44f06ae1dd23855e716f9a9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3a0103d3edb44d5a27976f33273aac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '835bf798230b619dca1731f118ae31a337f30955d2b436916dc266587d8b5f6a816f99fa8b9d2e16f6f6be2432553e5b5cdd3e8c93c98a07cd524066ccb5246c', 'id': '99e9b231-a220-4153-93fe-0134e26dc279', 'created_at': datetime.datetime(2026, 7, 7, 16, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99e9b231-a220-4153-93fe-0134e26dc279/file', 'properties': {}}, 'image_service': } Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Trying to clone edcb8d88-dea5-49be-9203-52a4a8c1635c from image 99e9b231-a220-4153-93fe-0134e26dc279 at location (None, [{'url': 'file:///opt/stack/data/glance/images/99e9b231-a220-4153-93fe-0134e26dc279', 'metadata': {}}]). {{(pid=87228) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-23365709-0903-4c74-b490-0e190af54f8a-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-23365709-0903-4c74-b490-0e190af54f8a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-quobyte-23365709-0903-4c74-b490-0e190af54f8a" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:15:02 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Image download 0.00 MB at 0.00 MB/s Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-23365709-0903-4c74-b490-0e190af54f8a" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:02 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5" returned: 0 in 0.720s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.615s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-538357660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c493581-981d-4e5d-88c4-61f4cf3bc0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e751deb209b74b70a5ba712eb744d20b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:55Z,use_quota=True,user_id='b43317a4913c4dffa8e56ed452c9d9d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Creating volume 6c493581-981d-4e5d-88c4-61f4cf3bc0eb {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:02 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d8180f-510e-4a9d-8555-6412f305a862]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e1048-9cd8-49c7-a6a0-0770dbcb58bc]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:02 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb 1073741824 Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:02 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22406f8-815a-4f00-ab05-b1bda9103d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032f19a3-0d25-402e-9efb-29acba1ea09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:02 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 (d66cc747-8d51-44a4-a7fc-c04f2f8a31d5): created successfully Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032f19a3-0d25-402e-9efb-29acba1ea09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (1b021c05-dcb2-45ec-8134-b9fdf13e9715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:02 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0694fda1-cc70-4098-bcf6-b1b587b45b5b tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created volume successfully. Jul 07 18:15:02 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a Jul 07 18:15:02 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:02 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD Jul 07 18:15:02 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:02 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.889s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:02 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Deleted volume successfully. Jul 07 18:15:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c6f1db9-625d-4a40-b8ff-b1d21cca79d3 tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-c279287c-dc4b-49ed-a2a0-b11e2b2b6b8b-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:03 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a" returned: 0 in 0.942s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:03 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD" returned: 0 in 0.950s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:03 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a Jul 07 18:15:03 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:03 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb 1073741824" returned: 0 in 1.040s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:03 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb Jul 07 18:15:03 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:03 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD Jul 07 18:15:03 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:03 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23365709-0903-4c74-b490-0e190af54f8a" returned: 0 in 0.693s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-23365709-0903-4c74-b490-0e190af54f8a" released by "delete_volume" :: held 1.719s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created reservations ['c0350d95-de46-4c05-97ed-329d6616b28a', '7208ab6b-35f3-4f04-96d6-a564eeb273bb', 'd5a38684-d142-46ab-a857-bde79274ada2', 'b8605a21-5a2d-4fca-ac19-be069b6ff863'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:04 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Temporary image 99e9b231-a220-4153-93fe-0134e26dc279 is fetched for user f1879dd8066e4855bdb42889ecf013bc. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:15:04 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb" returned: 0 in 0.739s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.417s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot afc34f82-6d69-4ea8-ad4a-e90937cd2f78 of volume 99945ece-5b07-4669-8d3d-97139747e9d2 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:15:04 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:04 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf6d05d-70e5-4541-9f9b-484d911286ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa621bde-0515-4a26-a2f5-0f7297cb2d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef557a3c-8834-4b61-ae2e-22f3ea5f3a87]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:04 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Volume volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb (6c493581-981d-4e5d-88c4-61f4cf3bc0eb): created successfully Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa621bde-0515-4a26-a2f5-0f7297cb2d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Flow 'volume_create_manager' (58c907f1-a342-4f31-bbc3-cf32e383e921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fbd229-7921-40fd-a8c9-0fb8bf7fec2b]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a1cc16a7-fba2-44d2-aac1-7d2104da23f6 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created volume successfully. Jul 07 18:15:04 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 Jul 07 18:15:04 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-22e3842c-e855-4253-904b-2dc404e9e0c1-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:04 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD Jul 07 18:15:04 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-22e3842c-e855-4253-904b-2dc404e9e0c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-quobyte-fffdf48c-7d3c-4330-8139-f7d23d2965d5" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-fffdf48c-7d3c-4330-8139-f7d23d2965d5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-quobyte-22e3842c-e855-4253-904b-2dc404e9e0c1" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-22e3842c-e855-4253-904b-2dc404e9e0c1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Deleting offline snapshot 22e3842c-e855-4253-904b-2dc404e9e0c1 of volume fffdf48c-7d3c-4330-8139-f7d23d2965d5 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] snapshot_file for this snap is: volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf88108-5fe1-46a1-aefb-3afaabff0962]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:04 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 Jul 07 18:15:04 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:04 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.798s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:04 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Deleted volume successfully. Jul 07 18:15:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-cab38df2-4143-4e8e-9770-94cdbf1828cc tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-23365709-0903-4c74-b490-0e190af54f8a-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:05 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD" returned: 0 in 0.859s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:05 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2" returned: 0 in 0.950s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:05 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 1G Jul 07 18:15:05 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:05 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD Jul 07 18:15:05 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-6c493581-981d-4e5d-88c4-61f4cf3bc0eb-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-6c493581-981d-4e5d-88c4-61f4cf3bc0eb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-quobyte-6c493581-981d-4e5d-88c4-61f4cf3bc0eb" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-6c493581-981d-4e5d-88c4-61f4cf3bc0eb" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f8aa37-1177-4419-8ee8-4c0480ae6430]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:05 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1" returned: 0 in 0.973s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ab797e-3ada-45e6-8dac-ce82b4a4b40a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:05 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb Jul 07 18:15:05 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:05 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 Jul 07 18:15:05 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:05 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD" returned: 1 in 0.841s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:06 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 1G" returned: 0 in 1.009s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99945ece-5b07-4669-8d3d-97139747e9d2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:06 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99945ece-5b07-4669-8d3d-97139747e9d2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 Jul 07 18:15:06 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:06 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb" returned: 0 in 0.798s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:06 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb Jul 07 18:15:06 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:06 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5" returned: 0 in 0.886s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:06 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 Jul 07 18:15:06 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:06 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99945ece-5b07-4669-8d3d-97139747e9d2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78" returned: 0 in 0.773s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:06 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 is being set with open permissions: ugo+rw Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:06 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 Jul 07 18:15:06 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:06 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-6c493581-981d-4e5d-88c4-61f4cf3bc0eb" returned: 0 in 0.736s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-6c493581-981d-4e5d-88c4-61f4cf3bc0eb" released by "delete_volume" :: held 1.580s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created reservations ['ad4bb872-0b78-4f9a-9f8e-54fdaa3977b8', '39099756-ad52-422d-b9ba-e47f8b879e13', '75bf70dc-0b78-4c11-a44a-2eb2e5d61e4f', '97738ae1-b336-4767-be39-a17d54454f32'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:07 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:07 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:07 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1" returned: 0 in 0.841s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:07 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1 Jul 07 18:15:07 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-quobyte-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:07 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78" returned: 0 in 0.765s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe64257-e999-4d58-b671-dff356488918]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:07 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.info Jul 07 18:15:07 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:07 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 Jul 07 18:15:07 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:07 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.759s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Deleted volume successfully. Jul 07 18:15:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-645bfe8b-b86e-492e-a5dc-8667151deca4 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-6c493581-981d-4e5d-88c4-61f4cf3bc0eb-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:08 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5.22e3842c-e855-4253-904b-2dc404e9e0c1" returned: 0 in 0.848s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-22e3842c-e855-4253-904b-2dc404e9e0c1" released by "_delete_snapshot" :: held 3.664s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-fffdf48c-7d3c-4330-8139-f7d23d2965d5" released by "delete_snapshot" :: held 3.700s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created reservations ['e0a29d21-4921-4d8a-b453-c5d4cccbb001', '6bc0c9cb-371b-4568-9e43-e38e2fb8647a', 'f39a4466-557d-4860-ab7a-0360c6a5eb56', '243381be-5e72-4f59-bf23-155fa88a4f95'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Delete snapshot completed successfully. Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-756b13d0-66c0-426f-ae49-34f5be8ee4eb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-22e3842c-e855-4253-904b-2dc404e9e0c1-delete_snapshot" released by "delete_snapshot" :: held 3.855s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:08 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.info" returned: 0 in 0.765s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:08 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.info is being set with open permissions: ugo+rw Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:08 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.info Jul 07 18:15:08 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:08 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5" returned: 0 in 0.854s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:08 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5 Jul 07 18:15:08 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-fffdf48c-7d3c-4330-8139-f7d23d2965d5-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-fffdf48c-7d3c-4330-8139-f7d23d2965d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "cinder-quobyte-fffdf48c-7d3c-4330-8139-f7d23d2965d5" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-fffdf48c-7d3c-4330-8139-f7d23d2965d5" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7527f0-4645-429e-a9c0-09e558be8a98]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:08 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 Jul 07 18:15:08 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:09 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.info" returned: 0 in 0.707s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.121s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.298s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcb8d88-dea5-49be-9203-52a4a8c1635c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a0103d3edb44d5a27976f33273aac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:02Z,use_quota=True,user_id='f1879dd8066e4855bdb42889ecf013bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Creating volume edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:09 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:09 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c 1073741824 Jul 07 18:15:09 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:09 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e9c225e9-afa6-4158-b294-cb4d80b54318 tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:15:09 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5" returned: 0 in 0.804s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5" released by "delete_volume" :: held 1.720s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created reservations ['02a64fbf-78ef-4148-af7e-2d97cf8a497e', '41b4b18e-feca-4643-865a-971e39307155', 'fe900958-c61b-4c05-b142-0eb9eba359a0', '1c6334fa-68da-406b-ae54-e595d5fa48f9'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:09 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:09 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:09 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5" returned: 0 in 0.835s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:09 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5 Jul 07 18:15:09 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-30a1ed83-6c8d-48b7-a769-e682a237a9a6-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:09 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-30a1ed83-6c8d-48b7-a769-e682a237a9a6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-quobyte-30a1ed83-6c8d-48b7-a769-e682a237a9a6" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-30a1ed83-6c8d-48b7-a769-e682a237a9a6" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-afc34f82-6d69-4ea8-ad4a-e90937cd2f78-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[752a374e-e072-4045-9341-79f1f4f12360]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-afc34f82-6d69-4ea8-ad4a-e90937cd2f78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-99945ece-5b07-4669-8d3d-97139747e9d2" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-99945ece-5b07-4669-8d3d-97139747e9d2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-afc34f82-6d69-4ea8-ad4a-e90937cd2f78" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-afc34f82-6d69-4ea8-ad4a-e90937cd2f78" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot afc34f82-6d69-4ea8-ad4a-e90937cd2f78 of volume 99945ece-5b07-4669-8d3d-97139747e9d2 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1c4be5-89bf-4ec0-a748-70cce4d1ef11]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:10 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c 1073741824" returned: 0 in 1.111s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:10 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 Jul 07 18:15:10 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:10 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:10 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fffdf48c-7d3c-4330-8139-f7d23d2965d5" returned: 0 in 0.818s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:10 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c Jul 07 18:15:10 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 Jul 07 18:15:10 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:10 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.923s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-quobyte-fffdf48c-7d3c-4330-8139-f7d23d2965d5" released by "delete_volume" :: held 1.744s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Deleted volume successfully. Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d4d083eb-2d87-490a-82db-87ebc5ecf73f tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-d66cc747-8d51-44a4-a7fc-c04f2f8a31d5-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Created reservations ['ce7f077d-35da-4350-9d82-bf637f501fef', '2b6a760b-c05f-4bec-9c9f-c9b2830a9b16', 'b1d2a5a6-d938-409d-bfd7-f0f5a4cb6cba', 'dce58ea9-d242-403a-a7f7-866f517bc1d1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:10 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:10 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:11 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c" returned: 0 in 0.773s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:11 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78" returned: 0 in 0.940s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99945ece-5b07-4669-8d3d-97139747e9d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411ee2b-6c56-42d1-b1c3-afec3bd55690]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:11 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Attempting download of 99e9b231-a220-4153-93fe-0134e26dc279 ((None, [{'url': 'file:///opt/stack/data/glance/images/99e9b231-a220-4153-93fe-0134e26dc279', 'metadata': {}}])) to volume edcb8d88-dea5-49be-9203-52a4a8c1635c. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6" returned: 0 in 1.188s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:11 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6 Jul 07 18:15:11 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9616e5a3-9c26-4b07-929d-b4dbca2dfc63]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99e9b231-a220-4153-93fe-0134e26dc279_50l61tho {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:11 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 Jul 07 18:15:11 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:11 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99e9b231-a220-4153-93fe-0134e26dc279_50l61tho Jul 07 18:15:11 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:11 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.973s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:11 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Deleted volume successfully. Jul 07 18:15:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f0170da-fa2c-4127-9c6f-b337524f9aeb tempest-CreateVolumesFromSnapshotTest-1506321837 None] Lock "cinder-fffdf48c-7d3c-4330-8139-f7d23d2965d5-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:12 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-30a1ed83-6c8d-48b7-a769-e682a237a9a6" returned: 0 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-30a1ed83-6c8d-48b7-a769-e682a237a9a6" released by "delete_volume" :: held 2.161s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:12 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:12 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99e9b231-a220-4153-93fe-0134e26dc279_50l61tho" returned: 0 in 0.896s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99e9b231-a220-4153-93fe-0134e26dc279_50l61tho {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2" returned: 0 in 1.037s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:12 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 Jul 07 18:15:12 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created reservations ['5d43821b-9b31-4673-8b10-95c988eab9a5', '84034340-3e54-432e-aa93-5cb4934b8387', '5c5817e5-f9a3-4c95-b57d-958dfd87fefd', 'a6b645ef-1b81-400a-b07f-5c43f6e2503e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:12 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99e9b231-a220-4153-93fe-0134e26dc279_50l61tho Jul 07 18:15:12 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:12 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:12 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:13 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99e9b231-a220-4153-93fe-0134e26dc279_50l61tho" returned: 1 in 0.848s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99e9b231-a220-4153-93fe-0134e26dc279_50l61tho' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[701d98ce-e199-4e91-a861-c14e070d5077]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:13 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78" returned: 0 in 0.955s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:13 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD Jul 07 18:15:13 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:13 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78 Jul 07 18:15:13 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:13 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.869s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:13 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Deleted volume successfully. Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f871a844-9e19-478c-b116-690611722965 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-30a1ed83-6c8d-48b7-a769-e682a237a9a6-delete_volume" released by "delete_volume" :: held 3.498s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-quobyte-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e059381-158f-44d0-87ec-f98505a52c82]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:13 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 Jul 07 18:15:13 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:14 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD" returned: 0 in 0.872s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:14 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2.afc34f82-6d69-4ea8-ad4a-e90937cd2f78" returned: 0 in 0.855s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:14 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD Jul 07 18:15:14 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-afc34f82-6d69-4ea8-ad4a-e90937cd2f78" released by "_delete_snapshot" :: held 3.978s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-99945ece-5b07-4669-8d3d-97139747e9d2" released by "delete_snapshot" :: held 4.010s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Created reservations ['989765cc-88c6-42fb-8d94-ef328344390b', 'eaf38984-c266-4fcc-aaba-b165f31bfcb0', '92dc22e1-f33e-4edc-bebf-a6f045a43c12', '48443baf-68cb-4525-80a0-0514531924ab'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-885e137b-c79c-4771-a27c-ce4a25b77114 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-afc34f82-6d69-4ea8-ad4a-e90937cd2f78-delete_snapshot" released by "delete_snapshot" :: held 4.237s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:14 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9" returned: 0 in 0.900s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-99945ece-5b07-4669-8d3d-97139747e9d2-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:14 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9 Jul 07 18:15:14 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-99945ece-5b07-4669-8d3d-97139747e9d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-99945ece-5b07-4669-8d3d-97139747e9d2" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-99945ece-5b07-4669-8d3d-97139747e9d2" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72f1d14-f71c-41d1-8d82-168a35bd75e2]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:14 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 Jul 07 18:15:14 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:14 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD" returned: 1 in 0.885s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] 99e9b231-a220-4153-93fe-0134e26dc279 was raw, converting to raw {{(pid=87228) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:15:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:14 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c Jul 07 18:15:14 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:15 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9" returned: 0 in 0.877s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9" released by "delete_volume" :: held 1.864s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=213,cinder:SELECT=158,cinder:INSERT=56,cinder:DELETE=19 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Flow 'volume_create_manager' (70aea2d1-53b5-4099-96f7-b9394615ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09313f2f-aa5e-4bb0-85bc-23c2cdc00022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=161,cinder:UPDATE=216,cinder:INSERT=55,cinder:DELETE=20 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09313f2f-aa5e-4bb0-85bc-23c2cdc00022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248150353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4263f6a-5eff-411f-ab78-5fb9eaee0327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c768ac00694709a147d5c9fe20a2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:15Z,use_quota=True,user_id='0c1b070791184b59b3d3ac01db390fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7356a7f0-995d-42e0-ade5-a0afe52cb1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7356a7f0-995d-42e0-ade5-a0afe52cb1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53ef221-ebe2-41fb-9cf3-73dcdde04579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53ef221-ebe2-41fb-9cf3-73dcdde04579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4263f6a-5eff-411f-ab78-5fb9eaee0327', 'volume_name': 'volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55173c2-fa9c-4b3c-a401-9d011b7dd36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55173c2-fa9c-4b3c-a401-9d011b7dd36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68f1840-0d0f-4640-84a9-bb7767e54e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Volume c4263f6a-5eff-411f-ab78-5fb9eaee0327: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327', 'volume_size': 1} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248150353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4263f6a-5eff-411f-ab78-5fb9eaee0327,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c768ac00694709a147d5c9fe20a2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:15Z,use_quota=True,user_id='0c1b070791184b59b3d3ac01db390fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Creating volume c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:15 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:15 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2" returned: 0 in 0.864s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:15 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 1073741824 Jul 07 18:15:15 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:15 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2 Jul 07 18:15:15 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created reservations ['a44e742c-a651-4896-96cc-6431daf838c8', '973e26e1-a940-4c80-8f5a-59e047832965', 'cc746e75-f55a-4c32-8dc3-50d51c2bd93b', 'cf3958f2-96b0-4c7e-9fbf-ffac9da4760a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:15 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:15 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:15 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c" returned: 0 in 0.974s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99e9b231-a220-4153-93fe-0134e26dc279_o6ganfiwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:15:15 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:15 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c 1G Jul 07 18:15:15 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-2e5d4a6d-aad5-4623-b9de-aab9d248b727-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-2e5d4a6d-aad5-4623-b9de-aab9d248b727-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-quobyte-2e5d4a6d-aad5-4623-b9de-aab9d248b727" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-2e5d4a6d-aad5-4623-b9de-aab9d248b727" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7219c5f-8ef0-4106-9640-e67259aabe14]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:16 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 Jul 07 18:15:16 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:16 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-99945ece-5b07-4669-8d3d-97139747e9d2" returned: 0 in 0.849s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-99945ece-5b07-4669-8d3d-97139747e9d2" released by "delete_volume" :: held 1.821s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Created reservations ['1488ca4f-b1ff-44cb-b660-9fa30bb0e1d6', '8751c945-56fb-47ee-8bcc-9f88d1e7d842', '49eb9415-67c4-4845-af16-70de67f69681', '824b7a79-f1fd-4e4e-8429-6f120871eb28'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:16 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.941s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Deleted volume successfully. Jul 07 18:15:16 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:16 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d0313b7d-7b96-449e-8ab2-4326cb22d4d1 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-8dc330ad-8bba-4b4c-9a3b-c7f0cc38a8b9-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:16 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 1073741824" returned: 0 in 1.331s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:17 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 Jul 07 18:15:17 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:17 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c 1G" returned: 0 in 1.205s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1c96fa-cd89-437d-a12a-18254106c39f]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:17 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c Jul 07 18:15:17 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:17 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727" returned: 0 in 1.393s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:17 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727 Jul 07 18:15:17 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (7bb2f7e9-4c49-481b-af2a-6c6707a85875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191c0cc4-9433-4dd1-a350-5a229d9a34af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191c0cc4-9433-4dd1-a350-5a229d9a34af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812798971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9f2b55-73c5-4662-9ded-dd9968fb5edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:18Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7baa2fe8-f271-4aed-af25-e3a222eebd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7baa2fe8-f271-4aed-af25-e3a222eebd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da4e859-07a5-4408-b2b9-26c75a6d254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da4e859-07a5-4408-b2b9-26c75a6d254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f9f2b55-73c5-4662-9ded-dd9968fb5edd', 'volume_name': 'volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe692ec6-9245-47bd-97f9-9dfad9b24176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe692ec6-9245-47bd-97f9-9dfad9b24176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a0436b-1b48-4947-8f37-c5ea3db6e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:17 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Volume 8f9f2b55-73c5-4662-9ded-dd9968fb5edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd', 'volume_size': 1} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:17 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 1.129s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:17 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:15:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1b72f81d-0315-42a9-9e8e-0a5c98f75e60 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-99945ece-5b07-4669-8d3d-97139747e9d2-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:18 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c" returned: 0 in 0.888s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:18 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327" returned: 0 in 1.099s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] <== create_volume: return (2506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.509s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1812798971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9f2b55-73c5-4662-9ded-dd9968fb5edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:18Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Creating volume 8f9f2b55-73c5-4662-9ded-dd9968fb5edd {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:18 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68f1840-0d0f-4640-84a9-bb7767e54e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4043ce29-9406-440f-9c4c-c911aae23646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:18 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd 1073741824 Jul 07 18:15:18 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:18 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Volume volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 (c4263f6a-5eff-411f-ab78-5fb9eaee0327): created successfully Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4043ce29-9406-440f-9c4c-c911aae23646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:18 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c Jul 07 18:15:18 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Flow 'volume_create_manager' (70aea2d1-53b5-4099-96f7-b9394615ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:18 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-750e9132-d3c0-479d-bb5a-dae3b1c6e538 tempest-VolumeDependencyTests-1247467256 None] Created volume successfully. Jul 07 18:15:18 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2e5d4a6d-aad5-4623-b9de-aab9d248b727" returned: 0 in 0.829s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-2e5d4a6d-aad5-4623-b9de-aab9d248b727" released by "delete_volume" :: held 2.284s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created reservations ['1b88e75c-b5ac-4810-9f43-777d56368694', 'cb8aa9c5-bc99-411e-908e-e8abf410ebce', '037c5ae5-fd1b-4770-b43b-77e4d1fae1cf', '676da004-4b24-4e5d-b63b-819d495bbf9b'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:18 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:18 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:19 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c" returned: 1 in 0.990s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Downloaded image 99e9b231-a220-4153-93fe-0134e26dc279 ((None, [{'url': 'file:///opt/stack/data/glance/images/99e9b231-a220-4153-93fe-0134e26dc279', 'metadata': {}}])) to volume edcb8d88-dea5-49be-9203-52a4a8c1635c successfully. {{(pid=87228) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Temporary image 99e9b231-a220-4153-93fe-0134e26dc279 for user f1879dd8066e4855bdb42889ecf013bc is deleted. {{(pid=87228) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.volume.volume_utils [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Marking volume edcb8d88-dea5-49be-9203-52a4a8c1635c as bootable. {{(pid=87228) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Copying metadata from image 99e9b231-a220-4153-93fe-0134e26dc279 to edcb8d88-dea5-49be-9203-52a4a8c1635c. {{(pid=87228) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Creating volume glance metadata for volume edcb8d88-dea5-49be-9203-52a4a8c1635c backed by image 99e9b231-a220-4153-93fe-0134e26dc279 with: {'image_id': '99e9b231-a220-4153-93fe-0134e26dc279', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '982af694c44f06ae1dd23855e716f9a9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87228) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e67a130-7fc9-485f-b93d-ae125720f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcb8d88-dea5-49be-9203-52a4a8c1635c', 'volume_size': 1, 'image_id': '99e9b231-a220-4153-93fe-0134e26dc279', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99e9b231-a220-4153-93fe-0134e26dc279', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '982af694c44f06ae1dd23855e716f9a9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3a0103d3edb44d5a27976f33273aac7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '835bf798230b619dca1731f118ae31a337f30955d2b436916dc266587d8b5f6a816f99fa8b9d2e16f6f6be2432553e5b5cdd3e8c93c98a07cd524066ccb5246c', 'id': '99e9b231-a220-4153-93fe-0134e26dc279', 'created_at': datetime.datetime(2026, 7, 7, 16, 14, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 15, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99e9b231-a220-4153-93fe-0134e26dc279/file', 'properties': {}}, 'image_service': }' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6d5636-fe91-4245-b167-e597a232a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Volume volume-edcb8d88-dea5-49be-9203-52a4a8c1635c (edcb8d88-dea5-49be-9203-52a4a8c1635c): created successfully Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6d5636-fe91-4245-b167-e597a232a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Flow 'volume_create_manager' (f048f8fc-4ecd-412b-a7c8-07abe418d078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-eefd8a57-dff6-4c59-9508-924aceea6e48 tempest-VolumeImageDependencyTests-586580437 None] Created volume successfully. Jul 07 18:15:19 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd 1073741824" returned: 0 in 1.243s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-582d4bcd-e976-4820-8183-1566e3113d7c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-582d4bcd-e976-4820-8183-1566e3113d7c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:19 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd Jul 07 18:15:19 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "cinder-quobyte-582d4bcd-e976-4820-8183-1566e3113d7c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-582d4bcd-e976-4820-8183-1566e3113d7c" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3a7e9a-d456-4523-9bea-ff811af593e0]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:19 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.794s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Deleted volume successfully. Jul 07 18:15:19 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c Jul 07 18:15:19 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-21ffd38e-1015-4ddf-b369-fba4909f4d95 tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-2e5d4a6d-aad5-4623-b9de-aab9d248b727-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:20 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" returned: 0 in 0.814s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.116s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a0436b-1b48-4947-8f37-c5ea3db6e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adf2f6d-303e-4f8b-821a-99464c6fb5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Creating offline snapshot afa7a388-f434-4ab5-8663-d5d37eb50cd2 of volume c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:15:20 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Volume volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd (8f9f2b55-73c5-4662-9ded-dd9968fb5edd): created successfully Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adf2f6d-303e-4f8b-821a-99464c6fb5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (7bb2f7e9-4c49-481b-af2a-6c6707a85875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Acquiring lock "cinder-edcb8d88-dea5-49be-9203-52a4a8c1635c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ec19d4-be61-4e74-8a2d-59c4dd82ba9b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9a182c4f-3666-44ac-aca1-30d1f3d5a023 tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:15:20 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Lock "cinder-edcb8d88-dea5-49be-9203-52a4a8c1635c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c" returned: 0 in 0.862s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:20 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c Jul 07 18:15:20 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Acquiring lock "cinder-quobyte-edcb8d88-dea5-49be-9203-52a4a8c1635c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Lock "cinder-quobyte-edcb8d88-dea5-49be-9203-52a4a8c1635c" acquired by "delete_volume" :: waited 0.032s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:20 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 Jul 07 18:15:20 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[016dd31b-bbdb-4afa-ba39-4177626bb0bf]: (4, 'raw') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:20 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c Jul 07 18:15:20 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:21 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-582d4bcd-e976-4820-8183-1566e3113d7c" returned: 0 in 0.760s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-quobyte-582d4bcd-e976-4820-8183-1566e3113d7c" released by "delete_volume" :: held 1.675s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Created reservations ['09bb6a8a-9297-43ae-8b70-7a18b573812b', '756d37ff-76be-4a25-88eb-af56007d1427', '6fd10550-b5b3-417b-b460-89e2f839919b', '1cba106d-d542-4815-bd69-57139dab4343'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:21 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:21 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:21 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327" returned: 0 in 1.043s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:21 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 1G Jul 07 18:15:21 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:21 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c" returned: 0 in 0.948s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:21 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c Jul 07 18:15:21 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:22 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.934s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:22 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:22 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Deleted volume successfully. Jul 07 18:15:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-2d56dd27-63a5-47d1-9f6e-af7b383bcc6d tempest-CreateVolumesFromSourceVolumeTest-1010920694 None] Lock "cinder-582d4bcd-e976-4820-8183-1566e3113d7c-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:22 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 1G" returned: 0 in 0.912s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:22 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 Jul 07 18:15:22 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:22 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c" returned: 1 in 0.865s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c' failed. Not Retrying. {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:22 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c Jul 07 18:15:22 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:23 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-edcb8d88-dea5-49be-9203-52a4a8c1635c" returned: 0 in 0.773s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:23 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2" returned: 0 in 0.878s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:23 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 is being set with open permissions: ugo+rw Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Lock "cinder-quobyte-edcb8d88-dea5-49be-9203-52a4a8c1635c" released by "delete_volume" :: held 2.693s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:23 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 Jul 07 18:15:23 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Created reservations ['0ace1987-3b97-4ab7-8abc-0e42f90cd58f', 'ff76f5f2-8c4c-46c8-a44e-c89de048e4b0', '880ab07a-c11f-4c1f-aadd-7fe193e53741', '289a2053-7827-48f6-9573-e958333a1985'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:23 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:23 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:23 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:23 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:24 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2" returned: 0 in 1.030s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:24 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.891s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Deleted volume successfully. Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-398734f9-8050-42f9-bd17-88f15054884c tempest-VolumeImageDependencyTests-586580437 None] Lock "cinder-edcb8d88-dea5-49be-9203-52a4a8c1635c-delete_volume" released by "delete_volume" :: held 3.930s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:24 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.info Jul 07 18:15:24 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:24 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.941s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:15:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:15:25 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.info" returned: 0 in 0.792s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:25 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.info is being set with open permissions: ugo+rw Jul 07 18:15:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:25 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.info Jul 07 18:15:25 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:25 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.info" returned: 0 in 0.795s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.672s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.048s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot d5b23da4-ab9e-48ee-b4d8-e160b822a2fa of volume 8f9f2b55-73c5-4662-9ded-dd9968fb5edd {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:15:26 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-49de9261-50f8-46a0-921a-2b9588b785c4 tempest-VolumeDependencyTests-1247467256 None] Create snapshot completed successfully Jul 07 18:15:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1482d338-5f73-4992-bd83-17975b62eb0b]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:26 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd Jul 07 18:15:26 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:26 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" returned: 0 in 0.982s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:27 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa 1G Jul 07 18:15:27 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Flow 'volume_create_manager' (b990bcc5-34d1-409e-a709-9d96f7e58557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08e6996-2ecc-4eb8-aa32-0ed4815f2827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08e6996-2ecc-4eb8-aa32-0ed4815f2827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1859593162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd601fd6-3576-4d47-994e-20df20754893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c768ac00694709a147d5c9fe20a2f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=afa7a388-f434-4ab5-8663-d5d37eb50cd2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:27Z,use_quota=True,user_id='0c1b070791184b59b3d3ac01db390fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a127198d-09b2-4357-bef4-d0435bb46d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a127198d-09b2-4357-bef4-d0435bb46d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd01adb7-6f6a-4405-a558-b2b845a7d95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd01adb7-6f6a-4405-a558-b2b845a7d95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd601fd6-3576-4d47-994e-20df20754893', 'volume_name': 'volume-dd601fd6-3576-4d47-994e-20df20754893', 'volume_size': 1, 'snapshot_id': 'afa7a388-f434-4ab5-8663-d5d37eb50cd2'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef60120-c319-4ff8-a425-6ae5332c7d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef60120-c319-4ff8-a425-6ae5332c7d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690ba02a-d0ad-4884-b1c9-a2f1d59a0cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Volume dd601fd6-3576-4d47-994e-20df20754893: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd601fd6-3576-4d47-994e-20df20754893', 'volume_size': 1, 'snapshot_id': 'afa7a388-f434-4ab5-8663-d5d37eb50cd2'} Jul 07 18:15:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:28 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa 1G" returned: 0 in 1.055s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:28 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa Jul 07 18:15:28 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:28 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa" returned: 0 in 0.907s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:28 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa is being set with open permissions: ugo+rw Jul 07 18:15:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:28 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa Jul 07 18:15:29 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:29 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa" returned: 0 in 0.724s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:29 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.info Jul 07 18:15:29 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:30 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.info" returned: 0 in 0.717s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:30 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.info is being set with open permissions: ugo+rw Jul 07 18:15:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:30 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.info Jul 07 18:15:30 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:31 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.info" returned: 0 in 0.712s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.198s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.864s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-quobyte-afa7a388-f434-4ab5-8663-d5d37eb50cd2-dd601fd6-3576-4d47-994e-20df20754893" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:31 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2d079ff4-9471-4a7e-9211-a6e797430807 tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-afa7a388-f434-4ab5-8663-d5d37eb50cd2-dd601fd6-3576-4d47-994e-20df20754893" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Creating volume dd601fd6-3576-4d47-994e-20df20754893 from snapshot afa7a388-f434-4ab5-8663-d5d37eb50cd2 {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-quobyte-dd601fd6-3576-4d47-994e-20df20754893" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-dd601fd6-3576-4d47-994e-20df20754893" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] snapshot: afa7a388-f434-4ab5-8663-d5d37eb50cd2, volume: dd601fd6-3576-4d47-994e-20df20754893, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[347e11c1-bf01-4ac0-8203-90430c9f20e0]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-d5b23da4-ab9e-48ee-b4d8-e160b822a2fa-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-d5b23da4-ab9e-48ee-b4d8-e160b822a2fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:31 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 Jul 07 18:15:31 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-d5b23da4-ab9e-48ee-b4d8-e160b822a2fa" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-d5b23da4-ab9e-48ee-b4d8-e160b822a2fa" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot d5b23da4-ab9e-48ee-b4d8-e160b822a2fa of volume 8f9f2b55-73c5-4662-9ded-dd9968fb5edd {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7b6e7d-3b92-4756-9958-c8238b60146c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:31 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa Jul 07 18:15:31 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:32 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2" returned: 0 in 1.038s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9c686f-d1ad-43ec-acc0-62673d82636c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:32 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 Jul 07 18:15:32 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:32 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa" returned: 0 in 0.941s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a2187b-5909-4a98-b94d-9c11791a4aec]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:32 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd Jul 07 18:15:32 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:33 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327" returned: 0 in 0.858s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:33 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:15:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:33 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 Jul 07 18:15:33 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:33 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" returned: 0 in 0.986s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:33 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa Jul 07 18:15:33 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:35 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (7e7d2cfa-b6a3-432d-8b6e-8d2c0480357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a54c234-d221-4f06-9eca-d66f1f807f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa" returned: 0 in 1.660s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:35 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa Jul 07 18:15:35 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a54c234-d221-4f06-9eca-d66f1f807f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174269597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e3de92-be10-40f3-a88c-95dbe91a4ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:35Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3421508-4056-4dd4-ae5f-d5f92d6f2847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3421508-4056-4dd4-ae5f-d5f92d6f2847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3e46df-ce46-441e-ab47-5f7dee03d6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3e46df-ce46-441e-ab47-5f7dee03d6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e3de92-be10-40f3-a88c-95dbe91a4ef9', 'volume_name': 'volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dd51d5-5fdc-4a26-9429-ae2cfee7620c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dd51d5-5fdc-4a26-9429-ae2cfee7620c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861f96d6-fe7b-4ac4-975f-73f67cce1b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:35 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Volume 22e3de92-be10-40f3-a88c-95dbe91a4ef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9', 'volume_size': 1} Jul 07 18:15:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:36 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd.d5b23da4-ab9e-48ee-b4d8-e160b822a2fa" returned: 0 in 1.452s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-d5b23da4-ab9e-48ee-b4d8-e160b822a2fa" released by "_delete_snapshot" :: held 5.213s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" released by "delete_snapshot" :: held 5.255s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:36 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Created reservations ['b6cc4e5e-39fc-49fc-a9a4-ff7366725fb9', '6c2602cc-cb26-44b9-a51d-43ed96e50137', '28c9b990-ee33-41e4-84b8-be3a17df8e35', 'ba15d107-ced9-4da8-9547-3108df93bb82'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:15:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-16637641-b0b0-435b-a076-f170f1334324 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-d5b23da4-ab9e-48ee-b4d8-e160b822a2fa-delete_snapshot" released by "delete_snapshot" :: held 5.615s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-8f9f2b55-73c5-4662-9ded-dd9968fb5edd-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-8f9f2b55-73c5-4662-9ded-dd9968fb5edd-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" acquired by "delete_volume" :: waited 0.048s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:37 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31336eb-d831-4ce6-8724-e8a0b945c698]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:38 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd Jul 07 18:15:38 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:39 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893" returned: 0 in 6.370s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:39 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cf86d9-dbb4-4829-987f-a78ff729c08c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:39 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" returned: 0 in 1.905s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:39 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd Jul 07 18:15:39 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:39 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 Jul 07 18:15:39 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:40 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" returned: 0 in 0.732s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-8f9f2b55-73c5-4662-9ded-dd9968fb5edd" released by "delete_volume" :: held 2.823s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Created reservations ['5e6b7525-acc5-49f8-969d-b63e67219064', '1f9c5dc3-3147-47fa-8a76-f7266602fb7a', 'd041446b-f7ae-4628-b43b-5ceb14e9e7bb', 'c6f61bf1-a686-438b-affb-2ca919a84b47'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:40 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:40 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:40 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327" returned: 0 in 1.049s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:15:40 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Converted 1024.00 MB image at 160.72 MB/s Jul 07 18:15:40 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 is being set with open permissions: ugo+rw Jul 07 18:15:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:40 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 Jul 07 18:15:40 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:41 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.818s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:15:41 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893" returned: 0 in 0.791s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1be60a0a-5d64-4e7b-b521-750303f3ba88 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-8f9f2b55-73c5-4662-9ded-dd9968fb5edd-delete_volume" released by "delete_volume" :: held 4.093s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-dd601fd6-3576-4d47-994e-20df20754893" released by "_copy_volume_from_snapshot" :: held 10.249s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-afa7a388-f434-4ab5-8663-d5d37eb50cd2-dd601fd6-3576-4d47-994e-20df20754893" released by "_create_volume_from_snapshot" :: held 10.290s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.320s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.097s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174269597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e3de92-be10-40f3-a88c-95dbe91a4ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:35Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Creating volume 22e3de92-be10-40f3-a88c-95dbe91a4ef9 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:41 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:41 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 1073741824 Jul 07 18:15:41 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690ba02a-d0ad-4884-b1c9-a2f1d59a0cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd601fd6-3576-4d47-994e-20df20754893', 'volume_size': 1, 'snapshot_id': 'afa7a388-f434-4ab5-8663-d5d37eb50cd2'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2f5712-dfc4-40c7-81c1-3f6261c328a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:41 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Volume volume-dd601fd6-3576-4d47-994e-20df20754893 (dd601fd6-3576-4d47-994e-20df20754893): created successfully Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2f5712-dfc4-40c7-81c1-3f6261c328a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Flow 'volume_create_manager' (b990bcc5-34d1-409e-a709-9d96f7e58557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (3127a463-6214-482b-80c3-65ff29fb7075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccd010d-422f-48db-acc3-ab2fed550650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccd010d-422f-48db-acc3-ab2fed550650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895397583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e85d40-2c78-47a9-8ba8-92863fe1bf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:42Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3d37d9-11d3-48a0-8963-9247d973a46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3d37d9-11d3-48a0-8963-9247d973a46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cb781b-c8c7-4255-8a5d-3daa55e31dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8cb781b-c8c7-4255-8a5d-3daa55e31dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e85d40-2c78-47a9-8ba8-92863fe1bf0a', 'volume_name': 'volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdae7d6c-972f-4598-9fcd-b9cf63df2c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdae7d6c-972f-4598-9fcd-b9cf63df2c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efed910-4c39-4a9e-bc32-f81b483362b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:41 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Volume 24e85d40-2c78-47a9-8ba8-92863fe1bf0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a', 'volume_size': 1} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0da4846b-0af4-447a-913d-9a6727e9a62a tempest-VolumeDependencyTests-1247467256 None] Created volume successfully. Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-afa7a388-f434-4ab5-8663-d5d37eb50cd2-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-afa7a388-f434-4ab5-8663-d5d37eb50cd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-quobyte-c4263f6a-5eff-411f-ab78-5fb9eaee0327" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-c4263f6a-5eff-411f-ab78-5fb9eaee0327" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-quobyte-afa7a388-f434-4ab5-8663-d5d37eb50cd2" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-afa7a388-f434-4ab5-8663-d5d37eb50cd2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Deleting offline snapshot afa7a388-f434-4ab5-8663-d5d37eb50cd2 of volume c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] snapshot_file for this snap is: volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9012823-3c43-4ade-94fa-7f78390b6ae3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:42 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 Jul 07 18:15:42 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:42 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 1073741824" returned: 0 in 0.950s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:42 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 Jul 07 18:15:42 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:42 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2" returned: 0 in 0.978s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:42 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:42 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac602b1-d5e2-4f4f-86f9-d686c48219ec]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:43 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 Jul 07 18:15:43 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:43 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9" returned: 0 in 0.856s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895397583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e85d40-2c78-47a9-8ba8-92863fe1bf0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:42Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Creating volume 24e85d40-2c78-47a9-8ba8-92863fe1bf0a {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:43 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:43 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a 1073741824 Jul 07 18:15:43 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861f96d6-fe7b-4ac4-975f-73f67cce1b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad75a52-d94c-4ecb-b713-806c749d91ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:43 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Volume volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 (22e3de92-be10-40f3-a88c-95dbe91a4ef9): created successfully Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad75a52-d94c-4ecb-b713-806c749d91ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:43 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (7e7d2cfa-b6a3-432d-8b6e-8d2c0480357f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:43 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e9a5d3ad-4562-4f3a-9929-0393c7ce2a8c tempest-ProjectReaderTests-422449400 None] Created volume successfully. Jul 07 18:15:44 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327" returned: 0 in 1.112s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:44 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 Jul 07 18:15:44 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:44 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a 1073741824" returned: 0 in 1.012s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:44 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a Jul 07 18:15:44 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:44 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2" returned: 0 in 0.837s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:44 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2 Jul 07 18:15:44 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:45 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" returned: 0 in 0.753s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.037s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Creating offline snapshot dd792686-b515-4315-a35e-654a26810267 of volume 22e3de92-be10-40f3-a88c-95dbe91a4ef9 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efed910-4c39-4a9e-bc32-f81b483362b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d36b5ef-1f53-47d7-8838-69e7efafa552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6234ff-01e9-465a-a3c8-617717967d0a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:45 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Volume volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a (24e85d40-2c78-47a9-8ba8-92863fe1bf0a): created successfully Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d36b5ef-1f53-47d7-8838-69e7efafa552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (3127a463-6214-482b-80c3-65ff29fb7075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-42d350ec-d288-4b3f-9b51-242097059239 tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:15:45 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 Jul 07 18:15:45 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:45 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327.afa7a388-f434-4ab5-8663-d5d37eb50cd2" returned: 0 in 0.673s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-afa7a388-f434-4ab5-8663-d5d37eb50cd2" released by "_delete_snapshot" :: held 3.730s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-c4263f6a-5eff-411f-ab78-5fb9eaee0327" released by "delete_snapshot" :: held 3.758s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Created reservations ['a411942e-1d61-4e53-a301-b1f0080fbedd', '9b4e2e79-85b9-4340-bbbb-113f09bf19f7', '854077d0-dca1-4b1e-bee2-c086075570ac', '100db0c0-577b-49f7-a06f-735a529ec21e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Delete snapshot completed successfully. Jul 07 18:15:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-692d5b8e-3301-4b48-94db-021f2d7a3da0 tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-afa7a388-f434-4ab5-8663-d5d37eb50cd2-delete_snapshot" released by "delete_snapshot" :: held 3.913s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-c4263f6a-5eff-411f-ab78-5fb9eaee0327-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-c4263f6a-5eff-411f-ab78-5fb9eaee0327-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-quobyte-c4263f6a-5eff-411f-ab78-5fb9eaee0327" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-c4263f6a-5eff-411f-ab78-5fb9eaee0327" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:46 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9" returned: 0 in 0.958s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f18f097-5192-4ecd-b660-a7e462b69d5c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:46 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 1G Jul 07 18:15:46 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:46 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 Jul 07 18:15:46 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:47 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327" returned: 0 in 0.818s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:47 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327 Jul 07 18:15:47 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:47 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 1G" returned: 0 in 0.907s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:47 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 Jul 07 18:15:47 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:47 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c4263f6a-5eff-411f-ab78-5fb9eaee0327" returned: 0 in 0.651s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-c4263f6a-5eff-411f-ab78-5fb9eaee0327" released by "delete_volume" :: held 1.549s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Created reservations ['c6a9e7b9-f24b-4308-8d23-4dbff58332f3', 'f8109ec8-6625-402f-a8e3-2738fd84471e', '9bb351ed-a722-4d37-996f-406c49a5c045', 'ab8348d9-c644-4aa0-bb45-771916539c6e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:47 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:47 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:47 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267" returned: 0 in 0.795s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:47 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 is being set with open permissions: ugo+rw Jul 07 18:15:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:47 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 Jul 07 18:15:47 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-dd601fd6-3576-4d47-994e-20df20754893-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-dd601fd6-3576-4d47-994e-20df20754893-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "cinder-quobyte-dd601fd6-3576-4d47-994e-20df20754893" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Flow 'volume_create_manager' (feed275c-3150-4240-bb27-9dbb49cc5263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25184e6-b31d-4b24-8105-086598d6f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-dd601fd6-3576-4d47-994e-20df20754893" acquired by "delete_volume" :: waited 0.057s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:48 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25184e6-b31d-4b24-8105-086598d6f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1841318906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01e6f2e-6eaf-47df-b7ff-7031f3e733ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b79f733ea4f7480fb2e46c49a1afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:48Z,use_quota=True,user_id='1bb8b725462045acb30fbd674a625b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83c884f-a5c6-41de-9d18-ffffd8030cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83c884f-a5c6-41de-9d18-ffffd8030cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163fb752-7a0b-4a91-a8b6-4b63f24c929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163fb752-7a0b-4a91-a8b6-4b63f24c929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01e6f2e-6eaf-47df-b7ff-7031f3e733ee', 'volume_name': 'volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9b849b-fef3-4c51-8872-eb9774ed9347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9b849b-fef3-4c51-8872-eb9774ed9347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93622e06-bc3b-4fd4-9037-8c6119c2da9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:48 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Volume a01e6f2e-6eaf-47df-b7ff-7031f3e733ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee', 'volume_size': 1} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5e8ba9-34c7-40f4-a400-1146a90ab31c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.796s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Deleted volume successfully. Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a7e42a2e-b3fc-4c26-8bf1-fb524cd937fd tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-c4263f6a-5eff-411f-ab78-5fb9eaee0327-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:48 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267" returned: 0 in 0.848s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:48 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 Jul 07 18:15:48 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:48 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.info Jul 07 18:15:48 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:49 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.info" returned: 0 in 0.681s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:49 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:49 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.info is being set with open permissions: ugo+rw Jul 07 18:15:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893" returned: 0 in 0.826s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:49 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.info Jul 07 18:15:49 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:49 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893 Jul 07 18:15:49 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:50 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-dd601fd6-3576-4d47-994e-20df20754893" returned: 0 in 0.632s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:50 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.info" returned: 0 in 0.658s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.966s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-quobyte-dd601fd6-3576-4d47-994e-20df20754893" released by "delete_volume" :: held 1.563s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.147s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot eee1492b-71ab-4011-b697-86fa08b12b2b of volume 24e85d40-2c78-47a9-8ba8-92863fe1bf0a {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[155adcb7-49be-44d6-bfa2-089917379c6e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:50 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b3dc9e00-b0a1-4511-9e6d-728005ed6876 tempest-ProjectReaderTests-422449400 None] Create snapshot completed successfully Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Created reservations ['ec4ade4e-c06e-4cd3-a9e6-3f99d4231349', '245972ff-4cdd-40ae-a8dc-83b446583b66', '1f5fdb58-ca70-4ec5-ae66-d017990216a8', '479df174-ccef-40cd-8814-f5be19d7fc60'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:50 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a Jul 07 18:15:50 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:50 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:50 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-dd792686-b515-4315-a35e-654a26810267-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Lock "cinder-dd792686-b515-4315-a35e-654a26810267-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-22e3de92-be10-40f3-a88c-95dbe91a4ef9" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-22e3de92-be10-40f3-a88c-95dbe91a4ef9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-dd792686-b515-4315-a35e-654a26810267" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-dd792686-b515-4315-a35e-654a26810267" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Deleting offline snapshot dd792686-b515-4315-a35e-654a26810267 of volume 22e3de92-be10-40f3-a88c-95dbe91a4ef9 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] snapshot_file for this snap is: volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7592dc-1229-4317-b07d-f9906639fd49]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:50 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 Jul 07 18:15:50 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:51 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.723s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Deleted volume successfully. Jul 07 18:15:51 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" returned: 0 in 0.880s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-13306a77-9162-484b-b4e8-5fdc2b8d673b tempest-VolumeDependencyTests-1247467256 None] Lock "cinder-dd601fd6-3576-4d47-994e-20df20754893-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:51 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b 1G Jul 07 18:15:51 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:51 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267" returned: 0 in 0.940s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc450bba-19db-4a01-8160-6b1b25197f41]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:51 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 Jul 07 18:15:51 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:52 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b 1G" returned: 0 in 0.923s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:52 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b Jul 07 18:15:52 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:52 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9" returned: 0 in 0.855s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:52 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 Jul 07 18:15:52 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:52 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b" returned: 0 in 0.802s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:52 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b is being set with open permissions: ugo+rw Jul 07 18:15:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:52 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b Jul 07 18:15:52 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:53 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267" returned: 0 in 0.820s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:53 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267 Jul 07 18:15:53 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:53 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b" returned: 0 in 0.698s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:53 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.info Jul 07 18:15:53 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Flow 'volume_create_manager' (64ac7413-e0a6-4c81-9d7d-11b0b4e173d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afe762e-c2d0-417d-9a9e-6da4eae084c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afe762e-c2d0-417d-9a9e-6da4eae084c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79f939e-0d84-433a-bfb0-e863972a6d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a27286674d4911bfb40f0123af73ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:54Z,use_quota=True,user_id='cd301713e2da4602b57a3ab67222da58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58212e9a-dc6b-43a0-9436-15020af8ce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58212e9a-dc6b-43a0-9436-15020af8ce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6c9b26-2d05-46cb-81e9-56d6619f7566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6c9b26-2d05-46cb-81e9-56d6619f7566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79f939e-0d84-433a-bfb0-e863972a6d96', 'volume_name': 'volume-e79f939e-0d84-433a-bfb0-e863972a6d96', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c3e01d-1bab-463e-83c1-e6fa079db350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c3e01d-1bab-463e-83c1-e6fa079db350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31f1b99-ff1e-4509-b2b4-30fd11f0eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:54 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Volume e79f939e-0d84-433a-bfb0-e863972a6d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79f939e-0d84-433a-bfb0-e863972a6d96', 'volume_size': 1} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:54 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9.dd792686-b515-4315-a35e-654a26810267" returned: 0 in 0.707s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-dd792686-b515-4315-a35e-654a26810267" released by "_delete_snapshot" :: held 3.465s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-22e3de92-be10-40f3-a88c-95dbe91a4ef9" released by "delete_snapshot" :: held 3.499s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Created reservations ['f40bf8f9-dd2c-4e41-bb5e-a2eec3c501a7', 'cac70437-7b99-417a-8fa3-c468ceb04f24', 'a3a8f5b8-0546-43cb-a9f2-555043a49a47', '36811df7-f5f7-4bb4-8602-0841f50c44b9'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:54 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.info" returned: 0 in 0.729s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:54 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.info is being set with open permissions: ugo+rw Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:54 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.info Jul 07 18:15:54 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Delete snapshot completed successfully. Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9212aec2-0a12-484b-8736-37cba72e77fd tempest-ProjectReaderTests-422449400 None] Lock "cinder-dd792686-b515-4315-a35e-654a26810267-delete_snapshot" released by "delete_snapshot" :: held 3.670s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:54 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.info" returned: 0 in 0.647s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.781s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.285s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1841318906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01e6f2e-6eaf-47df-b7ff-7031f3e733ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b79f733ea4f7480fb2e46c49a1afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:48Z,use_quota=True,user_id='1bb8b725462045acb30fbd674a625b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Creating volume a01e6f2e-6eaf-47df-b7ff-7031f3e733ee {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:54 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:54 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-22e3de92-be10-40f3-a88c-95dbe91a4ef9-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:55 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee 1073741824 Jul 07 18:15:55 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Lock "cinder-22e3de92-be10-40f3-a88c-95dbe91a4ef9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c498a3fc-121b-43fb-ae1c-ec14c36bcfb5 tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-22e3de92-be10-40f3-a88c-95dbe91a4ef9" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-22e3de92-be10-40f3-a88c-95dbe91a4ef9" acquired by "delete_volume" :: waited 0.013s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a6a646-fb2c-495a-a9d3-8b254a8abb3a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:55 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 Jul 07 18:15:55 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-eee1492b-71ab-4011-b697-86fa08b12b2b-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Lock "cinder-eee1492b-71ab-4011-b697-86fa08b12b2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-eee1492b-71ab-4011-b697-86fa08b12b2b" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-eee1492b-71ab-4011-b697-86fa08b12b2b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot eee1492b-71ab-4011-b697-86fa08b12b2b of volume 24e85d40-2c78-47a9-8ba8-92863fe1bf0a {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf79577-ed15-41e2-bbcb-26819b640d65]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:55 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b Jul 07 18:15:55 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:55 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee 1073741824" returned: 0 in 0.946s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:55 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9" returned: 0 in 0.894s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:56 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee Jul 07 18:15:56 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:56 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9 Jul 07 18:15:56 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:56 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b" returned: 0 in 0.887s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[410f1362-f3ac-48e8-bb1d-e6943337c90c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:56 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a Jul 07 18:15:56 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:56 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee" returned: 0 in 0.707s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.583s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:56 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79f939e-0d84-433a-bfb0-e863972a6d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a27286674d4911bfb40f0123af73ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:54Z,use_quota=True,user_id='cd301713e2da4602b57a3ab67222da58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Creating volume e79f939e-0d84-433a-bfb0-e863972a6d96 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:56 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-22e3de92-be10-40f3-a88c-95dbe91a4ef9" returned: 0 in 0.730s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:56 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 1073741824 Jul 07 18:15:56 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93622e06-bc3b-4fd4-9037-8c6119c2da9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a638f4-5ddf-4659-b033-7a970778feb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-22e3de92-be10-40f3-a88c-95dbe91a4ef9" released by "delete_volume" :: held 1.709s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:56 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Volume volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee (a01e6f2e-6eaf-47df-b7ff-7031f3e733ee): created successfully Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a638f4-5ddf-4659-b033-7a970778feb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Flow 'volume_create_manager' (feed275c-3150-4240-bb27-9dbb49cc5263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:56 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c611a26b-c9d8-4772-ab9d-97c78ca606e8 tempest-ProjectReaderTests-375108546 None] Created volume successfully. Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Created reservations ['e2b4662f-a5c9-4de1-aae8-d016bd145876', 'd4b57822-a690-46da-bff8-d0df017da5f1', '2e213183-5253-4cd5-9193-71bb641f1fab', 'd5ae093a-dc67-4c3e-90d9-45881c497168'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:56 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:56 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:57 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" returned: 0 in 0.903s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:57 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b Jul 07 18:15:57 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Acquiring lock "cinder-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Lock "cinder-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Acquiring lock "cinder-quobyte-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Lock "cinder-quobyte-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[216c94b8-69b9-4b96-a130-355f3654c5c3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:57 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee Jul 07 18:15:57 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:57 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.851s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Deleted volume successfully. Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d960071e-aafd-4b19-8125-2db06a9646bf tempest-ProjectReaderTests-422449400 None] Lock "cinder-22e3de92-be10-40f3-a88c-95dbe91a4ef9-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:57 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 1073741824" returned: 0 in 1.179s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:57 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 Jul 07 18:15:57 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (13611b19-367e-45dd-aacd-1b3cb7498088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da88bb9-6390-4d8b-b0a6-c11d069e9cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da88bb9-6390-4d8b-b0a6-c11d069e9cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558894890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70d2ea0-1dfa-4063-91d2-c03bb8cca499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:58Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf32d8aa-5272-49f3-bf57-4949d64528fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf32d8aa-5272-49f3-bf57-4949d64528fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eea4509-d080-4849-8e34-57d2f964d0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eea4509-d080-4849-8e34-57d2f964d0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b70d2ea0-1dfa-4063-91d2-c03bb8cca499', 'volume_name': 'volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a067b4-29ec-42f2-9e45-b4472abc1d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a067b4-29ec-42f2-9e45-b4472abc1d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59334a8c-e18c-49d9-9c15-5f79ba6adc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:58 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Volume b70d2ea0-1dfa-4063-91d2-c03bb8cca499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499', 'volume_size': 1} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:58 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b" returned: 0 in 0.965s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:58 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b Jul 07 18:15:58 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:58 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee" returned: 0 in 0.961s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:58 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee Jul 07 18:15:58 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:58 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96" returned: 0 in 0.724s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558894890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b70d2ea0-1dfa-4063-91d2-c03bb8cca499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:58Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Creating volume b70d2ea0-1dfa-4063-91d2-c03bb8cca499 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:58 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:58 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 1073741824 Jul 07 18:15:58 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31f1b99-ff1e-4509-b2b4-30fd11f0eff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79f939e-0d84-433a-bfb0-e863972a6d96', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144d3932-ef7c-4378-b6a2-9aea092cb754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:58 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Volume volume-e79f939e-0d84-433a-bfb0-e863972a6d96 (e79f939e-0d84-433a-bfb0-e863972a6d96): created successfully Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144d3932-ef7c-4378-b6a2-9aea092cb754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Flow 'volume_create_manager' (64ac7413-e0a6-4c81-9d7d-11b0b4e173d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:58 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-cd109b88-92bc-4808-9640-d2da728552bf tempest-CinderUnicodeTest-1560400558 None] Created volume successfully. Jul 07 18:15:59 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a.eee1492b-71ab-4011-b697-86fa08b12b2b" returned: 0 in 0.717s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-eee1492b-71ab-4011-b697-86fa08b12b2b" released by "_delete_snapshot" :: held 3.587s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" released by "delete_snapshot" :: held 3.616s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Created reservations ['9cd8a9d6-0c69-427f-aab6-12dd7905f24c', '27682386-f735-4db2-9dbd-e9b7b6375dc7', '1f8ea57e-dd41-49aa-854d-ba962f617f48', 'b56f6fb7-e068-4996-a61c-c5089496934c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d66b3889-7c3d-424a-b5a5-384297bfe4ba tempest-ProjectMemberTests-1312511502 None] Lock "cinder-eee1492b-71ab-4011-b697-86fa08b12b2b-delete_snapshot" released by "delete_snapshot" :: held 3.847s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:59 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee" returned: 0 in 0.737s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Lock "cinder-quobyte-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee" released by "delete_volume" :: held 1.746s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Created reservations ['a778e942-2b5e-4e23-8401-aeda2e94067b', '8169c73b-8daa-4aed-9e2a-3f50a00427b3', 'c17d948e-85d1-43fe-b7e1-d24cf72574ac', '7ebc54ac-c7d6-455c-9290-6da86b75c4b1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:59 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:15:59 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:59 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 1073741824" returned: 0 in 1.049s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:59 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 Jul 07 18:15:59 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-24e85d40-2c78-47a9-8ba8-92863fe1bf0a-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-24e85d40-2c78-47a9-8ba8-92863fe1bf0a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0399e9c-68b2-4c0d-a51d-d71183b3a121]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Flow 'volume_create_manager' (90cf9e78-a52c-42cc-9175-d125f5f6bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6726809f-cf8c-41ce-8f4d-d7950734ccf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6726809f-cf8c-41ce-8f4d-d7950734ccf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1301324909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de58cd4-b55f-4b06-a28b-333908de7534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a27286674d4911bfb40f0123af73ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:00Z,use_quota=True,user_id='cd301713e2da4602b57a3ab67222da58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ed34b4-927f-40ea-b8c9-24f28a828eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a Jul 07 18:16:00 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ed34b4-927f-40ea-b8c9-24f28a828eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b69a273-5452-498f-b2b6-4ec34f430a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b69a273-5452-498f-b2b6-4ec34f430a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de58cd4-b55f-4b06-a28b-333908de7534', 'volume_name': 'volume-7de58cd4-b55f-4b06-a28b-333908de7534', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111c500c-268c-4c3f-a3d4-2a97cf509ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111c500c-268c-4c3f-a3d4-2a97cf509ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ce99f5-20da-44f4-9a9d-f996776e602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Volume 7de58cd4-b55f-4b06-a28b-333908de7534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de58cd4-b55f-4b06-a28b-333908de7534', 'volume_size': 1} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:00 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.893s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Deleted volume successfully. Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-abb28209-d70e-417d-8e48-1e9cc1c38e7f tempest-ProjectReaderTests-375108546 None] Lock "cinder-a01e6f2e-6eaf-47df-b7ff-7031f3e733ee-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Flow 'volume_create_manager' (b6148df4-dc63-4c1c-a25b-c92a166671fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83a15ee-fb46-43d3-938f-1e3ec93b9abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83a15ee-fb46-43d3-938f-1e3ec93b9abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797272624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d4b26f-812e-4bd2-8cc1-5994f96186a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b79f733ea4f7480fb2e46c49a1afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:01Z,use_quota=True,user_id='1bb8b725462045acb30fbd674a625b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ada18d-8011-4110-a5dc-8ae144bd70d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ada18d-8011-4110-a5dc-8ae144bd70d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6f599b-2d7d-41ee-a1c3-c3a698875b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6f599b-2d7d-41ee-a1c3-c3a698875b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d4b26f-812e-4bd2-8cc1-5994f96186a4', 'volume_name': 'volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45a80a0-1aaf-47e2-9558-02e85bbd5633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45a80a0-1aaf-47e2-9558-02e85bbd5633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6154b45e-e287-4213-9805-42eabd1c939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Volume 23d4b26f-812e-4bd2-8cc1-5994f96186a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4', 'volume_size': 1} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" returned: 0 in 0.891s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1301324909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de58cd4-b55f-4b06-a28b-333908de7534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72a27286674d4911bfb40f0123af73ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:00Z,use_quota=True,user_id='cd301713e2da4602b57a3ab67222da58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Creating volume 7de58cd4-b55f-4b06-a28b-333908de7534 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:00 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59334a8c-e18c-49d9-9c15-5f79ba6adc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 1073741824 Jul 07 18:16:00 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1df40b-8d36-44ea-afb8-cf78c124061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:00 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Volume volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 (b70d2ea0-1dfa-4063-91d2-c03bb8cca499): created successfully Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b1df40b-8d36-44ea-afb8-cf78c124061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (13611b19-367e-45dd-aacd-1b3cb7498088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-578849ad-f077-4258-90a4-c2651ec07391 tempest-ProjectReaderTests-422449400 None] Created volume successfully. Jul 07 18:16:01 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" returned: 0 in 0.957s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:01 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a Jul 07 18:16:01 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:01 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 1073741824" returned: 0 in 0.926s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:01 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 Jul 07 18:16:01 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:01 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" returned: 0 in 0.696s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-24e85d40-2c78-47a9-8ba8-92863fe1bf0a" released by "delete_volume" :: held 1.755s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Created reservations ['6ee9a102-cfa0-41a5-b462-f0717c70a280', 'c01b1871-5d19-4b68-9fac-9355135f712d', 'eccf09b9-ef71-43ff-b043-87fcb544d1f6', 'e8b5bf67-feb6-4ed9-acc1-af61be2b8d66'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:01 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:01 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:02 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534" returned: 0 in 0.666s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.652s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1797272624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d4b26f-812e-4bd2-8cc1-5994f96186a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b79f733ea4f7480fb2e46c49a1afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:01Z,use_quota=True,user_id='1bb8b725462045acb30fbd674a625b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Creating volume 23d4b26f-812e-4bd2-8cc1-5994f96186a4 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:02 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ce99f5-20da-44f4-9a9d-f996776e602d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de58cd4-b55f-4b06-a28b-333908de7534', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb32c5e-551e-43d3-bc0b-c8fce4158d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:02 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 1073741824 Jul 07 18:16:02 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:02 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Volume volume-7de58cd4-b55f-4b06-a28b-333908de7534 (7de58cd4-b55f-4b06-a28b-333908de7534): created successfully Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb32c5e-551e-43d3-bc0b-c8fce4158d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Flow 'volume_create_manager' (90cf9e78-a52c-42cc-9175-d125f5f6bf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:02 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e2f714ea-c51d-456c-b13a-d76446b8ef0c tempest-CinderUnicodeTest-1560400558 None] Created volume successfully. Jul 07 18:16:02 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.646s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:02 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c79801f7-a77b-4b1c-881c-679c6cb438c9 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-24e85d40-2c78-47a9-8ba8-92863fe1bf0a-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (67b4c2e3-684a-433e-ba40-9e5145164eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2f87cd-6eef-46a4-a5ac-5b6fb51966e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2f87cd-6eef-46a4-a5ac-5b6fb51966e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335376019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:03Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3832563a-cccf-49c3-b670-64ae997e7102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3832563a-cccf-49c3-b670-64ae997e7102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642495d5-a541-4cff-a711-818ee67d8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (642495d5-a541-4cff-a711-818ee67d8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01', 'volume_name': 'volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5c9c10-921b-4cc5-97eb-84a6b622ae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5c9c10-921b-4cc5-97eb-84a6b622ae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785f5ada-0036-46c6-87cc-76a0592ea5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:02 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Volume cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01', 'volume_size': 1} Jul 07 18:16:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:03 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 1073741824" returned: 0 in 0.828s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:03 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 Jul 07 18:16:03 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:03 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4" returned: 0 in 0.629s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.326s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Creating offline snapshot 8d720163-d1fd-49c3-a279-571ca2127b85 of volume b70d2ea0-1dfa-4063-91d2-c03bb8cca499 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6154b45e-e287-4213-9805-42eabd1c939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543da5d1-d58f-420f-a5b4-8f2697fd6dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e454aff-e211-4ce0-95a6-6044d3ecc314]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:03 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Volume volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 (23d4b26f-812e-4bd2-8cc1-5994f96186a4): created successfully Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543da5d1-d58f-420f-a5b4-8f2697fd6dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:03 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Flow 'volume_create_manager' (b6148df4-dc63-4c1c-a25b-c92a166671fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b96dd5ba-6da3-47bb-a513-b447c1b69755 tempest-ProjectReaderTests-375108546 None] Created volume successfully. Jul 07 18:16:04 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 Jul 07 18:16:04 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:04 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" returned: 0 in 0.752s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:04 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 1G Jul 07 18:16:04 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Acquiring lock "cinder-23d4b26f-812e-4bd2-8cc1-5994f96186a4-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Lock "cinder-23d4b26f-812e-4bd2-8cc1-5994f96186a4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Acquiring lock "cinder-quobyte-23d4b26f-812e-4bd2-8cc1-5994f96186a4" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Lock "cinder-quobyte-23d4b26f-812e-4bd2-8cc1-5994f96186a4" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:05 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1be508-ec70-487d-9a2c-a9dc88717f0f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:05 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 Jul 07 18:16:05 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:05 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 1G" returned: 0 in 0.837s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:05 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 Jul 07 18:16:05 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:05 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4" returned: 0 in 0.810s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:05 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4 Jul 07 18:16:05 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:06 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85" returned: 0 in 0.755s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:06 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 is being set with open permissions: ugo+rw Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:06 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 Jul 07 18:16:06 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:06 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-23d4b26f-812e-4bd2-8cc1-5994f96186a4" returned: 0 in 0.637s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Lock "cinder-quobyte-23d4b26f-812e-4bd2-8cc1-5994f96186a4" released by "delete_volume" :: held 1.497s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Created reservations ['dd03f19c-a368-42d1-9c3a-f0b5ffc753ea', 'f449b060-565e-4ac8-9b27-afa50e7790fb', '70f52bc1-3cbf-42f2-8d34-2edadaa2bf98', 'e56b0cfd-e6f6-4c2b-a5f0-fe4140ba1535'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:06 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:06 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:06 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85" returned: 0 in 0.679s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:06 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.info Jul 07 18:16:06 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:07 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.680s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:07 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Deleted volume successfully. Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-76f6c8ff-d692-40a3-ab65-b619d25a0d1a tempest-ProjectReaderTests-375108546 None] Lock "cinder-23d4b26f-812e-4bd2-8cc1-5994f96186a4-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:07 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Flow 'volume_create_manager' (f3888b30-126b-4ec0-baaf-4f37044b48ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2cb38e-b16a-4a21-8e69-bbb760439e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.info" returned: 0 in 0.694s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:07 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.info is being set with open permissions: ugo+rw Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:07 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.info Jul 07 18:16:07 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2cb38e-b16a-4a21-8e69-bbb760439e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135297706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cdf8310-0745-4c3e-a652-76a9c38ba588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b79f733ea4f7480fb2e46c49a1afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:08Z,use_quota=True,user_id='1bb8b725462045acb30fbd674a625b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2c34bd-fb3e-4510-a949-4050e4d59a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2c34bd-fb3e-4510-a949-4050e4d59a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486184a6-56e7-4711-b44e-8c456cc55269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486184a6-56e7-4711-b44e-8c456cc55269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cdf8310-0745-4c3e-a652-76a9c38ba588', 'volume_name': 'volume-9cdf8310-0745-4c3e-a652-76a9c38ba588', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5167466f-bfad-4a8d-aa7c-560a829d76d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5167466f-bfad-4a8d-aa7c-560a829d76d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f34b46-aed8-4162-b811-31f9ed04d585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:07 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Volume 9cdf8310-0745-4c3e-a652-76a9c38ba588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cdf8310-0745-4c3e-a652-76a9c38ba588', 'volume_size': 1} Jul 07 18:16:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:08 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.info" returned: 0 in 0.619s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.415s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.436s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335376019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:03Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Creating volume cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:08 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:08 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 1073741824 Jul 07 18:16:08 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:08 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-97302ac7-61eb-44ad-8acc-93d41f6da842 tempest-ProjectReaderTests-422449400 None] Create snapshot completed successfully Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-8d720163-d1fd-49c3-a279-571ca2127b85-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Lock "cinder-8d720163-d1fd-49c3-a279-571ca2127b85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-8d720163-d1fd-49c3-a279-571ca2127b85" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-8d720163-d1fd-49c3-a279-571ca2127b85" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Deleting offline snapshot 8d720163-d1fd-49c3-a279-571ca2127b85 of volume b70d2ea0-1dfa-4063-91d2-c03bb8cca499 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] snapshot_file for this snap is: volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b09d361-b52e-4724-ad6d-510da88de865]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:09 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 Jul 07 18:16:09 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:09 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 1073741824" returned: 0 in 0.838s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:09 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 Jul 07 18:16:09 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:09 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85" returned: 0 in 0.805s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a57620-772f-49a6-bc00-1f22a6a8caba]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:09 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" returned: 0 in 0.668s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.317s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785f5ada-0036-46c6-87cc-76a0592ea5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:09 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 Jul 07 18:16:09 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded212cd-1546-4041-86b3-080c6a2f5f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Creating offline snapshot 966187d9-790f-4677-92cd-eb9dae4244c5 of volume 7de58cd4-b55f-4b06-a28b-333908de7534 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:16:09 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Volume volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 (cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01): created successfully Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded212cd-1546-4041-86b3-080c6a2f5f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (67b4c2e3-684a-433e-ba40-9e5145164eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df3699b-190f-40b6-a0c4-1f0677bcf0c4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:09 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5d422750-9b8e-42c5-b266-8120894fb0be tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:16:10 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 Jul 07 18:16:10 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:10 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" returned: 0 in 0.835s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:10 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 Jul 07 18:16:10 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:10 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534" returned: 0 in 0.841s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:10 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 1G Jul 07 18:16:10 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:11 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85" returned: 0 in 0.722s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:11 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85 Jul 07 18:16:11 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:11 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 1G" returned: 0 in 0.864s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de58cd4-b55f-4b06-a28b-333908de7534 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:11 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de58cd4-b55f-4b06-a28b-333908de7534 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 Jul 07 18:16:11 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:11 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499.8d720163-d1fd-49c3-a279-571ca2127b85" returned: 0 in 0.632s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-8d720163-d1fd-49c3-a279-571ca2127b85" released by "_delete_snapshot" :: held 3.100s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" released by "delete_snapshot" :: held 3.126s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:12 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Created reservations ['6d3df2e9-8beb-4700-977a-767c7406e55f', 'f4b812e2-1027-453c-b7b4-3d57bc6984c3', '1b238710-4da7-4847-9041-de9d1d4b5cec', 'b4b1f407-f117-4c25-993d-c56b02cbd6e3'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:12 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Delete snapshot completed successfully. Jul 07 18:16:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6c56b72b-8229-4681-94bc-1a1aeb7866e8 tempest-ProjectReaderTests-422449400 None] Lock "cinder-8d720163-d1fd-49c3-a279-571ca2127b85-delete_snapshot" released by "delete_snapshot" :: held 3.271s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:12 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de58cd4-b55f-4b06-a28b-333908de7534 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5" returned: 0 in 0.725s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:12 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 is being set with open permissions: ugo+rw Jul 07 18:16:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:12 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 Jul 07 18:16:12 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:13 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5" returned: 0 in 0.649s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-b70d2ea0-1dfa-4063-91d2-c03bb8cca499-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:13 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.info Jul 07 18:16:13 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Lock "cinder-b70d2ea0-1dfa-4063-91d2-c03bb8cca499-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb228b9-7912-42c6-9c31-62ab4c327d2a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:13 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 Jul 07 18:16:13 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:13 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.info" returned: 0 in 0.762s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:13 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.info is being set with open permissions: ugo+rw Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:13 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.info Jul 07 18:16:13 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:13 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" returned: 0 in 0.805s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:14 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499 Jul 07 18:16:14 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:14 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.info" returned: 0 in 0.655s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.649s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.783s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2135297706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cdf8310-0745-4c3e-a652-76a9c38ba588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b79f733ea4f7480fb2e46c49a1afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:08Z,use_quota=True,user_id='1bb8b725462045acb30fbd674a625b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Creating volume 9cdf8310-0745-4c3e-a652-76a9c38ba588 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:14 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:14 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 1073741824 Jul 07 18:16:14 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-8267ab13-bc63-420f-a2d5-0a4c6ed64bbb tempest-CinderUnicodeTest-1560400558 None] Create snapshot completed successfully Jul 07 18:16:14 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" returned: 0 in 0.704s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-b70d2ea0-1dfa-4063-91d2-c03bb8cca499" released by "delete_volume" :: held 1.572s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Created reservations ['cb298fb6-25b9-4ebb-9ec8-b6a97e00e50d', '23154634-9204-4443-9781-338fe3c2d307', '6daf5743-432a-41a9-bf51-9326430cccf5', 'e2c7a18f-70a2-4797-87f8-13fe92034819'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:14 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:14 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "cinder-966187d9-790f-4677-92cd-eb9dae4244c5-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-966187d9-790f-4677-92cd-eb9dae4244c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "cinder-quobyte-7de58cd4-b55f-4b06-a28b-333908de7534" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-quobyte-7de58cd4-b55f-4b06-a28b-333908de7534" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "cinder-quobyte-966187d9-790f-4677-92cd-eb9dae4244c5" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-quobyte-966187d9-790f-4677-92cd-eb9dae4244c5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Deleting offline snapshot 966187d9-790f-4677-92cd-eb9dae4244c5 of volume 7de58cd4-b55f-4b06-a28b-333908de7534 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] snapshot_file for this snap is: volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5a922d-5cbd-4b7a-81ef-55db5a23ae5f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:15 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 Jul 07 18:16:15 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:15 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 1073741824" returned: 0 in 0.951s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:15 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 Jul 07 18:16:15 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:15 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.860s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:15 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Deleted volume successfully. Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=124,cinder:INSERT=54,cinder:UPDATE=182,cinder:DELETE=14 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-9da41618-f363-486a-b37c-33920b6bc516 tempest-ProjectReaderTests-422449400 None] Lock "cinder-b70d2ea0-1dfa-4063-91d2-c03bb8cca499-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=169,cinder:SELECT=139,cinder:INSERT=43,cinder:DELETE=17 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (fd052b6e-9d82-41cd-bb91-77242bcd9a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb3a5b3-e207-465d-924a-f73972d2bdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb3a5b3-e207-465d-924a-f73972d2bdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1391555412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:16Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3eb725-d116-4fc5-9df3-108e28943a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e3eb725-d116-4fc5-9df3-108e28943a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a9e7f-448a-482b-b38f-7ef9d5e30c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33a9e7f-448a-482b-b38f-7ef9d5e30c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251', 'volume_name': 'volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68a6d4e-752e-44b5-81b3-ca967a5c3828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68a6d4e-752e-44b5-81b3-ca967a5c3828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7b428d-c34a-4803-8658-592ac26c2977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Volume 7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251', 'volume_size': 1} Jul 07 18:16:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:16 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5" returned: 0 in 0.908s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7de58cd4-b55f-4b06-a28b-333908de7534(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[673783a5-cdda-4445-b327-fcbc1c767811]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:16 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 Jul 07 18:16:16 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:16 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588" returned: 0 in 0.743s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.879s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot 72395217-c756-455e-a124-65c5c3600bb8 of volume cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f34b46-aed8-4162-b811-31f9ed04d585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cdf8310-0745-4c3e-a652-76a9c38ba588', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666026ea-dd9a-4510-8b2a-4b98a16d10a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[45499af2-7dac-4674-9892-02e44a70c3b5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:16 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Volume volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 (9cdf8310-0745-4c3e-a652-76a9c38ba588): created successfully Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666026ea-dd9a-4510-8b2a-4b98a16d10a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Flow 'volume_create_manager' (f3888b30-126b-4ec0-baaf-4f37044b48ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-febd2344-0a4d-45a9-ab48-2874209e2ad6 tempest-ProjectReaderTests-375108546 None] Created volume successfully. Jul 07 18:16:16 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 Jul 07 18:16:16 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:16 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534" returned: 0 in 0.731s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:16 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 Jul 07 18:16:16 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:17 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" returned: 0 in 0.805s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:17 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 1G Jul 07 18:16:17 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Acquiring lock "cinder-9cdf8310-0745-4c3e-a652-76a9c38ba588-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Lock "cinder-9cdf8310-0745-4c3e-a652-76a9c38ba588-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Acquiring lock "cinder-quobyte-9cdf8310-0745-4c3e-a652-76a9c38ba588" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Lock "cinder-quobyte-9cdf8310-0745-4c3e-a652-76a9c38ba588" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6160fa7-19e5-4b4f-af01-1f72f01ec442]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:17 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 Jul 07 18:16:17 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:17 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5" returned: 0 in 0.770s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:17 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5 Jul 07 18:16:17 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:17 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 1G" returned: 0 in 0.825s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:17 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 Jul 07 18:16:17 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:18 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588" returned: 0 in 0.809s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:18 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588 Jul 07 18:16:18 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:18 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534.966187d9-790f-4677-92cd-eb9dae4244c5" returned: 0 in 0.680s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-quobyte-966187d9-790f-4677-92cd-eb9dae4244c5" released by "_delete_snapshot" :: held 3.219s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-quobyte-7de58cd4-b55f-4b06-a28b-333908de7534" released by "delete_snapshot" :: held 3.243s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Created reservations ['5278f5c2-030f-4814-8657-3e784e4faf4e', '03d471da-d654-4afa-b9e0-dda0462cf587', '8c84a4c7-4893-4ee7-bb8c-6babb50c4d60', 'c19bdf2d-1312-438b-b5f4-925af8d83faa'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:18 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Delete snapshot completed successfully. Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-0f4b3dca-51f4-4cf8-a0bd-519e5e547a4f tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-966187d9-790f-4677-92cd-eb9dae4244c5-delete_snapshot" released by "delete_snapshot" :: held 3.411s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:18 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8" returned: 0 in 0.726s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:18 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 is being set with open permissions: ugo+rw Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:18 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 Jul 07 18:16:18 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:18 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-9cdf8310-0745-4c3e-a652-76a9c38ba588" returned: 0 in 0.725s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Lock "cinder-quobyte-9cdf8310-0745-4c3e-a652-76a9c38ba588" released by "delete_volume" :: held 1.580s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:18 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Created reservations ['34e4c44d-5703-4a22-844d-053c0ef4f881', '9d15f135-4aeb-401b-b97f-60e38f3591ec', 'cadf72c8-c7fc-4d2f-abba-fa24a01fa25e', '05365b62-d0bb-4b59-85c2-5500d6ad2457'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:19 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:19 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "cinder-7de58cd4-b55f-4b06-a28b-333908de7534-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-7de58cd4-b55f-4b06-a28b-333908de7534-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "cinder-quobyte-7de58cd4-b55f-4b06-a28b-333908de7534" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-quobyte-7de58cd4-b55f-4b06-a28b-333908de7534" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67eadef-254f-4c6e-b1f1-c3d76ab74b88]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:19 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8" returned: 0 in 0.695s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:19 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.info Jul 07 18:16:19 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:19 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 Jul 07 18:16:19 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:19 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.741s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:19 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Deleted volume successfully. Jul 07 18:16:19 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-181c25b4-06af-45d6-a85f-55c5e67ecff1 tempest-ProjectReaderTests-375108546 None] Lock "cinder-9cdf8310-0745-4c3e-a652-76a9c38ba588-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Flow 'volume_create_manager' (dc643a07-1774-4c15-bfa8-3dc6a891afc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ca43e1-efb0-45c1-a9ca-874d80ba87e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ca43e1-efb0-45c1-a9ca-874d80ba87e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799293777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d81956-579a-4355-a70a-9c460c611c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b79f733ea4f7480fb2e46c49a1afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:20Z,use_quota=True,user_id='1bb8b725462045acb30fbd674a625b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edba5fbb-f1db-4c80-91f2-c5abb2841f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edba5fbb-f1db-4c80-91f2-c5abb2841f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e5eb39-861f-4dca-a0c3-98778af68373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e5eb39-861f-4dca-a0c3-98778af68373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d81956-579a-4355-a70a-9c460c611c43', 'volume_name': 'volume-37d81956-579a-4355-a70a-9c460c611c43', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2936dc8-700e-4192-8d84-61a23ea90796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2936dc8-700e-4192-8d84-61a23ea90796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7a00d7-4f2b-42a2-81b8-232b369ea7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:20 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Volume 37d81956-579a-4355-a70a-9c460c611c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d81956-579a-4355-a70a-9c460c611c43', 'volume_size': 1} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:20 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.info" returned: 0 in 0.777s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:20 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.info is being set with open permissions: ugo+rw Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:20 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.info Jul 07 18:16:20 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:20 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534" returned: 0 in 0.872s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:20 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534 Jul 07 18:16:20 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:20 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.info" returned: 0 in 0.641s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.579s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.920s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1391555412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:16Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Creating volume 7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:20 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:20 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 1073741824 Jul 07 18:16:20 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b4ea5d27-88a5-4e77-9c6d-c3e56b34e21f tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:16:20 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7de58cd4-b55f-4b06-a28b-333908de7534" returned: 0 in 0.677s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:20 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-quobyte-7de58cd4-b55f-4b06-a28b-333908de7534" released by "delete_volume" :: held 1.638s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Created reservations ['73d73564-c1e3-4e10-80c8-393bd4381d90', 'c6b6b937-8767-48bc-be59-00dd5e9fe60a', '7c3c5408-96fe-47aa-b800-24645fe11210', 'b97be8fd-4fb3-41ed-910c-8a6d47633327'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:21 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:21 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "cinder-e79f939e-0d84-433a-bfb0-e863972a6d96-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-e79f939e-0d84-433a-bfb0-e863972a6d96-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "cinder-quobyte-e79f939e-0d84-433a-bfb0-e863972a6d96" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-quobyte-e79f939e-0d84-433a-bfb0-e863972a6d96" acquired by "delete_volume" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcd5d88-10c2-4fa2-9cb6-5be1a5a43e38]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:21 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 Jul 07 18:16:21 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:21 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.692s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Deleted volume successfully. Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-3b025c43-eef4-42c6-8aa4-c7e89d01f942 tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-7de58cd4-b55f-4b06-a28b-333908de7534-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:21 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 1073741824" returned: 0 in 0.952s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-72395217-c756-455e-a124-65c5c3600bb8-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:21 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 Jul 07 18:16:21 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Lock "cinder-72395217-c756-455e-a124-65c5c3600bb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-72395217-c756-455e-a124-65c5c3600bb8" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-72395217-c756-455e-a124-65c5c3600bb8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot 72395217-c756-455e-a124-65c5c3600bb8 of volume cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[04990ff3-1548-479d-82ea-2a44e132e1d5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:22 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 Jul 07 18:16:22 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:22 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96" returned: 0 in 0.855s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:22 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96 Jul 07 18:16:22 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:22 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" returned: 0 in 0.674s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.405s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799293777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d81956-579a-4355-a70a-9c460c611c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3b79f733ea4f7480fb2e46c49a1afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:20Z,use_quota=True,user_id='1bb8b725462045acb30fbd674a625b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Creating volume 37d81956-579a-4355-a70a-9c460c611c43 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:22 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:22 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 1073741824 Jul 07 18:16:22 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7b428d-c34a-4803-8658-592ac26c2977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fff7701-54ab-4574-9aa4-2526f95bcb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:22 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Volume volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 (7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251): created successfully Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fff7701-54ab-4574-9aa4-2526f95bcb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (fd052b6e-9d82-41cd-bb91-77242bcd9a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:22 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-65a508a0-41af-490f-82b9-670b72746b45 tempest-ProjectReaderTests-422449400 None] Created volume successfully. Jul 07 18:16:22 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8" returned: 0 in 0.827s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[db68022c-1883-4765-ada1-6e919e478dc9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:22 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 Jul 07 18:16:22 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:23 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-e79f939e-0d84-433a-bfb0-e863972a6d96" returned: 0 in 0.688s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-quobyte-e79f939e-0d84-433a-bfb0-e863972a6d96" released by "delete_volume" :: held 1.590s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Created reservations ['7f4b629f-1dd6-4416-b445-4e2eac2d3db1', '81a19fd5-fd52-4c0d-8e7e-7523247ac31d', 'f88cb1a4-2eb6-4f8b-b6af-073d5e45ee5a', '6dd001bb-7ca7-4301-8b14-bcfae5601a64'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:23 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:23 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:23 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 1073741824" returned: 0 in 1.056s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:23 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" returned: 0 in 0.833s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:23 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 Jul 07 18:16:23 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:23 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 Jul 07 18:16:23 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:23 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:23 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:24 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.801s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Deleted volume successfully. Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c7fdb399-0971-4bc7-abb5-1fc6018a032b tempest-CinderUnicodeTest-1560400558 None] Lock "cinder-e79f939e-0d84-433a-bfb0-e863972a6d96-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:24 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8" returned: 0 in 0.889s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:24 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8 Jul 07 18:16:24 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:24 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:24 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.817s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43" returned: 0 in 0.996s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.179s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b7a00d7-4f2b-42a2-81b8-232b369ea7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d81956-579a-4355-a70a-9c460c611c43', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814e62d3-9c9b-4c84-b5ef-ad54295bb6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Creating offline snapshot 860546b8-a7df-40c8-9b35-1ffcd48364bd of volume 7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:16:24 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Volume volume-37d81956-579a-4355-a70a-9c460c611c43 (37d81956-579a-4355-a70a-9c460c611c43): created successfully Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814e62d3-9c9b-4c84-b5ef-ad54295bb6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Flow 'volume_create_manager' (dc643a07-1774-4c15-bfa8-3dc6a891afc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[435d26aa-8658-414f-ac78-667ce54ce9b1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a27058cb-db01-4261-af8c-68a5ce2e9626 tempest-ProjectReaderTests-375108546 None] Created volume successfully. Jul 07 18:16:24 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 Jul 07 18:16:24 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:25 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01.72395217-c756-455e-a124-65c5c3600bb8" returned: 0 in 0.786s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-72395217-c756-455e-a124-65c5c3600bb8" released by "_delete_snapshot" :: held 3.444s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" released by "delete_snapshot" :: held 3.468s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Acquiring lock "cinder-37d81956-579a-4355-a70a-9c460c611c43-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Lock "cinder-37d81956-579a-4355-a70a-9c460c611c43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Created reservations ['03a5e46e-4fab-42f8-9b3b-8992e4372499', 'f1288654-d5ef-4a96-a17b-1f7823537979', '21082585-6d57-41f2-b4c1-3823cbf8137b', '33f143cb-976d-47ff-aa28-4a09e1c2aa01'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Acquiring lock "cinder-quobyte-37d81956-579a-4355-a70a-9c460c611c43" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Lock "cinder-quobyte-37d81956-579a-4355-a70a-9c460c611c43" acquired by "delete_volume" :: waited 0.030s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1084d3b3-4401-45a3-8be2-24eb8c690e5c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:25 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-4ea14eca-a90d-40c5-beb1-3f98872feeab tempest-ProjectMemberTests-1312511502 None] Lock "cinder-72395217-c756-455e-a124-65c5c3600bb8-delete_snapshot" released by "delete_snapshot" :: held 3.739s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:25 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" returned: 0 in 0.991s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:25 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 Jul 07 18:16:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:25 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:25 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd 1G Jul 07 18:16:25 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c34929-de45-4171-9fe3-b20bd73324f1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:26 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 Jul 07 18:16:26 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:26 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43" returned: 0 in 0.885s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:26 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43 Jul 07 18:16:26 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:26 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd 1G" returned: 0 in 1.032s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:26 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd Jul 07 18:16:26 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:27 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" returned: 0 in 0.905s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:27 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:27 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01 Jul 07 18:16:27 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-37d81956-579a-4355-a70a-9c460c611c43" returned: 0 in 0.782s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Lock "cinder-quobyte-37d81956-579a-4355-a70a-9c460c611c43" released by "delete_volume" :: held 1.734s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Created reservations ['848a88ae-d203-434c-907a-c439fcb8b588', '17af4664-cb3f-4ad2-b419-740859066938', '5538c13c-7cc9-4dc5-a5ab-7aaec33f0290', '096772b7-98c7-4864-ba7c-aa63829b821d'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:27 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:27 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:27 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd" returned: 0 in 0.779s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:27 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd is being set with open permissions: ugo+rw Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:27 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd Jul 07 18:16:27 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:27 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" returned: 0 in 0.761s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01" released by "delete_volume" :: held 1.761s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ba9441da-fb20-4d90-998e-fcefda8a0aae tempest-ProjectAdminTests-440783888 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.690715789795, 'free_capacity_gb': 1775.690715789795, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87228) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Created reservations ['4c18993c-faaf-44f7-96ef-6c3d5dcaebc7', '30dce681-60ed-404d-927a-42b6b8a78277', '7684be83-d9ea-4584-85fb-5f09f8afbd73', 'bbbf7527-0dd2-4df6-bdc1-e60364633cad'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:28 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:28 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:28 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.787s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Deleted volume successfully. Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-61dff288-0980-4b5d-a342-a4fce8706e83 tempest-ProjectReaderTests-375108546 None] Lock "cinder-37d81956-579a-4355-a70a-9c460c611c43-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:28 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd" returned: 0 in 0.795s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:28 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.info Jul 07 18:16:28 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:29 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (ef3bbf91-10a1-48c8-ab77-83645731e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf79c1a8-13ed-40ae-a195-75467ccac934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.965s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf79c1a8-13ed-40ae-a195-75467ccac934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1662752535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa684fa8-4478-4bd6-bd48-e54fb392e28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:29Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494178f1-f0ac-4f99-a9b8-8bc35c1fa753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (494178f1-f0ac-4f99-a9b8-8bc35c1fa753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858e8360-6371-4603-96f8-3d6c9e55dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858e8360-6371-4603-96f8-3d6c9e55dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa684fa8-4478-4bd6-bd48-e54fb392e28c', 'volume_name': 'volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ff754-379c-41bb-ab06-374001b73077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525ff754-379c-41bb-ab06-374001b73077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace7df67-f44f-4404-9843-5f8ebc19ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:29 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Volume fa684fa8-4478-4bd6-bd48-e54fb392e28c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c', 'volume_size': 1} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-27a02f51-e0fd-4a4b-806c-7e8f3a6f1562 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-cd7878d0-9e37-4ba9-9b8c-89dfa78b4b01-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:29 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.info" returned: 0 in 0.972s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:29 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.info is being set with open permissions: ugo+rw Jul 07 18:16:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:29 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.info Jul 07 18:16:29 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:30 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.info" returned: 0 in 0.691s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.405s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1662752535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa684fa8-4478-4bd6-bd48-e54fb392e28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:29Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Creating volume fa684fa8-4478-4bd6-bd48-e54fb392e28c {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:30 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:30 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c 1073741824 Jul 07 18:16:30 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:30 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-65cd88af-fa13-45e3-8a48-caf16cabdfaa tempest-ProjectReaderTests-422449400 None] Create snapshot completed successfully Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-860546b8-a7df-40c8-9b35-1ffcd48364bd-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Lock "cinder-860546b8-a7df-40c8-9b35-1ffcd48364bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-860546b8-a7df-40c8-9b35-1ffcd48364bd" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-860546b8-a7df-40c8-9b35-1ffcd48364bd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Deleting offline snapshot 860546b8-a7df-40c8-9b35-1ffcd48364bd of volume 7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] snapshot_file for this snap is: volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[28da9716-2d2f-4558-9a1d-af0c4c9ef28e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:30 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:30 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c 1073741824" returned: 0 in 0.927s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:31 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c Jul 07 18:16:31 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:31 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd Jul 07 18:16:31 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:31 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c" returned: 0 in 0.722s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace7df67-f44f-4404-9843-5f8ebc19ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee67fdb-4114-44ea-9efb-5c5d9f414c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:31 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd" returned: 0 in 0.864s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:16:31 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Volume volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c (fa684fa8-4478-4bd6-bd48-e54fb392e28c): created successfully Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee67fdb-4114-44ea-9efb-5c5d9f414c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (ef3bbf91-10a1-48c8-ab77-83645731e14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[08518745-4b7c-4b18-8075-0bd62ebd211d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:31 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:31 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ad76db27-d7ac-4883-a1bd-07d4a7022d9d tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:16:31 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 Jul 07 18:16:31 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:32 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot 2d03517e-ceeb-448f-a5e1-5d390eb3f07b of volume fa684fa8-4478-4bd6-bd48-e54fb392e28c {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:16:32 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[05851c9c-36ab-4024-8831-ca31f7c8a664]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:32 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c Jul 07 18:16:32 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:32 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" returned: 0 in 0.818s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:32 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd Jul 07 18:16:32 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:33 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c" returned: 0 in 0.863s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:33 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b 1G Jul 07 18:16:33 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:33 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd" returned: 0 in 0.795s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:33 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:33 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd Jul 07 18:16:33 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:34 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251.860546b8-a7df-40c8-9b35-1ffcd48364bd" returned: 0 in 0.633s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-860546b8-a7df-40c8-9b35-1ffcd48364bd" released by "_delete_snapshot" :: held 3.242s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" released by "delete_snapshot" :: held 3.268s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:34 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b 1G" returned: 0 in 0.850s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:34 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b Jul 07 18:16:34 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Created reservations ['b8f483a0-0ecc-46d1-82ec-41c8447d638d', '7ee8490e-abaa-47e9-8493-3a9b3aa56e37', '50a54922-3b8b-4fc6-a9ed-9001a63d37dd', '1ce99a71-d6ac-485b-ae14-1f4035c4f062'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:34 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Delete snapshot completed successfully. Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-82ff72bb-a35e-4171-84f3-bd7f06e3d91a tempest-ProjectReaderTests-422449400 None] Lock "cinder-860546b8-a7df-40c8-9b35-1ffcd48364bd-delete_snapshot" released by "delete_snapshot" :: held 3.448s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:34 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b" returned: 0 in 0.719s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:34 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b is being set with open permissions: ugo+rw Jul 07 18:16:34 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:34 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b Jul 07 18:16:34 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Lock "cinder-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:35 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:35 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c19e6e-9d20-4668-b479-2875b1c3a363]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:35 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 Jul 07 18:16:35 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:35 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b" returned: 0 in 0.646s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:35 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:35 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.info Jul 07 18:16:35 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:36 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" returned: 0 in 0.794s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:36 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251 Jul 07 18:16:36 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:36 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.info" returned: 0 in 0.725s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:36 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.info is being set with open permissions: ugo+rw Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:36 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.info Jul 07 18:16:36 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:36 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" returned: 0 in 0.760s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251" released by "delete_volume" :: held 1.619s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Created reservations ['6ee59748-2ea4-4310-b53a-f57fcbb1b991', 'ba3fbb69-5319-4abd-86ff-dd7ef44b5508', '156cd12a-dea2-4bce-8561-cae497fd43a8', '80d88c34-441e-4d04-8502-645788f11a00'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:36 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:37 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:37 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:37 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.info" returned: 0 in 0.712s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.643s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-04567f18-a4e5-4868-ba8b-5f29cb14fe56 tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:16:37 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.652s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:37 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Deleted volume successfully. Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-2d03517e-ceeb-448f-a5e1-5d390eb3f07b-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-288f77f5-21a5-454e-974e-5674e1542efa tempest-ProjectReaderTests-422449400 None] Lock "cinder-7caf02cb-ee9a-4c6a-8a7f-ddbc2f621251-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Lock "cinder-2d03517e-ceeb-448f-a5e1-5d390eb3f07b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-fa684fa8-4478-4bd6-bd48-e54fb392e28c" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-fa684fa8-4478-4bd6-bd48-e54fb392e28c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-2d03517e-ceeb-448f-a5e1-5d390eb3f07b" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-2d03517e-ceeb-448f-a5e1-5d390eb3f07b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot 2d03517e-ceeb-448f-a5e1-5d390eb3f07b of volume fa684fa8-4478-4bd6-bd48-e54fb392e28c {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[227c5646-5e27-4d63-b17c-1c602e5abdb2]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:37 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (52afa6b9-02c7-4e0f-89eb-7af74d32d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:37 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee9d6d9-69c5-4d39-b6be-325b80b2b459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cee9d6d9-69c5-4d39-b6be-325b80b2b459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519417680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599f0f03-e565-4803-94be-60b05deba8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:38Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd23586-ad0d-4809-a3dc-5ce92e202a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd23586-ad0d-4809-a3dc-5ce92e202a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1ef6c5-3d28-4bb0-8b30-ca0457e81c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1ef6c5-3d28-4bb0-8b30-ca0457e81c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '599f0f03-e565-4803-94be-60b05deba8a6', 'volume_name': 'volume-599f0f03-e565-4803-94be-60b05deba8a6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bcac32-c8d3-4c9c-9821-79b70056e3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bcac32-c8d3-4c9c-9821-79b70056e3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8229a40-9f79-46f0-8725-ad60af832e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:37 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Volume 599f0f03-e565-4803-94be-60b05deba8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-599f0f03-e565-4803-94be-60b05deba8a6', 'volume_size': 1} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519417680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=599f0f03-e565-4803-94be-60b05deba8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:38Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Creating volume 599f0f03-e565-4803-94be-60b05deba8a6 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:37 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:37 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:37 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 1073741824 Jul 07 18:16:37 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:38 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b" returned: 0 in 0.835s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:38 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:16:38 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce73e45-2c53-4255-8d93-c46617433463]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:38 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c Jul 07 18:16:38 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:38 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 1073741824" returned: 0 in 0.938s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:38 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:38 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 Jul 07 18:16:38 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:39 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c" returned: 0 in 0.845s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:39 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b Jul 07 18:16:39 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:39 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6" returned: 0 in 0.677s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8229a40-9f79-46f0-8725-ad60af832e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-599f0f03-e565-4803-94be-60b05deba8a6', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26af56e5-ec75-4eb1-ae96-54e8778d31b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:39 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Volume volume-599f0f03-e565-4803-94be-60b05deba8a6 (599f0f03-e565-4803-94be-60b05deba8a6): created successfully Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26af56e5-ec75-4eb1-ae96-54e8778d31b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:39 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (52afa6b9-02c7-4e0f-89eb-7af74d32d053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:39 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d5ff7b54-38a4-45a5-b4fc-c0de2e57573b tempest-ProjectReaderTests-422449400 None] Created volume successfully. Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Creating offline snapshot f2a1743e-59be-4541-8bbb-6c131684836d of volume 599f0f03-e565-4803-94be-60b05deba8a6 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c358b0e-6ff8-4e60-a973-7b8aa814f80f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:40 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 Jul 07 18:16:40 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:40 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b" returned: 0 in 0.859s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:40 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b Jul 07 18:16:40 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:40 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6" returned: 0 in 0.800s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:40 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d 1G Jul 07 18:16:40 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:41 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c.2d03517e-ceeb-448f-a5e1-5d390eb3f07b" returned: 0 in 0.707s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-2d03517e-ceeb-448f-a5e1-5d390eb3f07b" released by "_delete_snapshot" :: held 3.369s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-fa684fa8-4478-4bd6-bd48-e54fb392e28c" released by "delete_snapshot" :: held 3.400s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:41 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Created reservations ['4d4beff2-de7b-40b7-a7eb-87b706dd21ee', 'df190682-65bd-4ed7-afe0-0ee0778692ff', 'edcd2647-6276-4bcd-9e24-c0bc0c2bce7b', 'c78ba1f6-3f81-444a-b790-93b97b56e651'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:41 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:16:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-295324d2-00d6-4f88-aced-6de5e5ab693e tempest-ProjectMemberTests-1312511502 None] Lock "cinder-2d03517e-ceeb-448f-a5e1-5d390eb3f07b-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:41 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d 1G" returned: 0 in 0.889s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:41 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599f0f03-e565-4803-94be-60b05deba8a6 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:41 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599f0f03-e565-4803-94be-60b05deba8a6 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d Jul 07 18:16:41 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:41 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-fa684fa8-4478-4bd6-bd48-e54fb392e28c-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-fa684fa8-4478-4bd6-bd48-e54fb392e28c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-fa684fa8-4478-4bd6-bd48-e54fb392e28c" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-fa684fa8-4478-4bd6-bd48-e54fb392e28c" acquired by "delete_volume" :: waited 0.013s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[552910e5-4598-495d-a3f5-33de29c71161]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:42 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c Jul 07 18:16:42 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:42 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-599f0f03-e565-4803-94be-60b05deba8a6 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d" returned: 0 in 0.792s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:42 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d is being set with open permissions: ugo+rw Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:42 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d Jul 07 18:16:42 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:42 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c" returned: 0 in 0.857s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:42 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:43 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c Jul 07 18:16:43 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:43 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d" returned: 0 in 0.678s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:43 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.info Jul 07 18:16:43 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:43 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-fa684fa8-4478-4bd6-bd48-e54fb392e28c" returned: 0 in 0.763s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-fa684fa8-4478-4bd6-bd48-e54fb392e28c" released by "delete_volume" :: held 1.690s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Created reservations ['6c9b08e7-5bc7-42da-9625-df4dda40c703', '9e4fcb21-96b3-480d-b060-7524508c05b9', 'ac2186c1-ad66-4464-b8d9-a8d9a3a1fe08', '24690768-839b-4eba-89cf-814938ef4fd1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:43 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:43 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:43 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:44 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.info" returned: 0 in 0.799s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:44 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.info is being set with open permissions: ugo+rw Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:44 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.info Jul 07 18:16:44 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:44 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.901s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:44 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-d9e6a98b-bd12-4050-8a1c-c17358c63d90 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-fa684fa8-4478-4bd6-bd48-e54fb392e28c-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (c2c43fd4-ea03-4e07-9261-f507c1f96262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8654df03-1386-45df-aaed-1a1f6507381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8654df03-1386-45df-aaed-1a1f6507381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1704281803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:45Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef313077-1b66-41d8-8b17-129d98a2b704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:44 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef313077-1b66-41d8-8b17-129d98a2b704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e35a90-4a1a-4ca7-90c7-df09d6b28443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e35a90-4a1a-4ca7-90c7-df09d6b28443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1', 'volume_name': 'volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bfc222-822e-472e-948c-624e99fe7b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bfc222-822e-472e-948c-624e99fe7b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:45 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5edacac-fe39-48e6-ba22-22c61956292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:45 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Volume c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1', 'volume_size': 1} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.info" returned: 0 in 0.859s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.922s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1704281803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:45Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Creating volume c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:45 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:45 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 1073741824 Jul 07 18:16:45 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:45 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-fd5c0326-ae4d-406f-b83c-7eab0a09c4f7 tempest-ProjectReaderTests-422449400 None] Create snapshot completed successfully Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-f2a1743e-59be-4541-8bbb-6c131684836d-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Lock "cinder-f2a1743e-59be-4541-8bbb-6c131684836d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-599f0f03-e565-4803-94be-60b05deba8a6" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-599f0f03-e565-4803-94be-60b05deba8a6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-f2a1743e-59be-4541-8bbb-6c131684836d" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-f2a1743e-59be-4541-8bbb-6c131684836d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Deleting offline snapshot f2a1743e-59be-4541-8bbb-6c131684836d of volume 599f0f03-e565-4803-94be-60b05deba8a6 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] snapshot_file for this snap is: volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9dd95c-2e28-40d1-a1fc-9c4ce421996e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:45 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d Jul 07 18:16:45 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:45 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 1073741824" returned: 0 in 0.880s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:45 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:45 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 Jul 07 18:16:45 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:46 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d" returned: 0 in 0.765s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-599f0f03-e565-4803-94be-60b05deba8a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee441f7-88b1-475c-bb76-8187425fba1e]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:46 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 Jul 07 18:16:46 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:46 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" returned: 0 in 0.642s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5edacac-fe39-48e6-ba22-22c61956292a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad7c85c-cc16-4469-83cf-949b7c0bc3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:46 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Volume volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 (c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1): created successfully Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad7c85c-cc16-4469-83cf-949b7c0bc3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (c2c43fd4-ea03-4e07-9261-f507c1f96262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:46 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-edcae3ce-4f67-46e9-bc19-935fefb22ddd tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot 553ef64d-befe-49fc-a445-84420f070262 of volume c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f02f41-c487-41b3-a8a2-56ec0f9b1839]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:46 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:47 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6" returned: 0 in 0.782s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:47 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d Jul 07 18:16:47 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:47 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 Jul 07 18:16:47 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:47 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" returned: 0 in 0.763s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:47 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 1G Jul 07 18:16:47 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:47 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d" returned: 0 in 0.771s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:47 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:47 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d Jul 07 18:16:47 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:48 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6.f2a1743e-59be-4541-8bbb-6c131684836d" returned: 0 in 0.665s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-f2a1743e-59be-4541-8bbb-6c131684836d" released by "_delete_snapshot" :: held 3.096s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-599f0f03-e565-4803-94be-60b05deba8a6" released by "delete_snapshot" :: held 3.123s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:48 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 1G" returned: 0 in 0.814s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:48 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:48 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 Jul 07 18:16:48 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:48 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Created reservations ['77b9d315-6a86-42b0-8f62-446b9016ba68', 'ea13bcd7-9997-417d-b28f-3b70d44d83dc', '33f33c64-9a55-43f7-90f6-a0e68d4d68e6', '6e653093-4e2e-45e4-acfb-cfbee4607810'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:48 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Delete snapshot completed successfully. Jul 07 18:16:48 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-e5f24e4d-0d37-4f76-9b7e-d1bd95587e58 tempest-ProjectReaderTests-422449400 None] Lock "cinder-f2a1743e-59be-4541-8bbb-6c131684836d-delete_snapshot" released by "delete_snapshot" :: held 3.287s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:49 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262" returned: 0 in 0.678s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:49 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 is being set with open permissions: ugo+rw Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:49 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 Jul 07 18:16:49 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-599f0f03-e565-4803-94be-60b05deba8a6-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Lock "cinder-599f0f03-e565-4803-94be-60b05deba8a6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-599f0f03-e565-4803-94be-60b05deba8a6" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-599f0f03-e565-4803-94be-60b05deba8a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f22f59-45ab-413f-9c30-e13158407cc9]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:49 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 Jul 07 18:16:49 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:49 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262" returned: 0 in 0.647s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:49 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:49 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.info Jul 07 18:16:49 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:50 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6" returned: 0 in 0.811s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:50 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.info" returned: 0 in 0.677s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:50 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.info is being set with open permissions: ugo+rw Jul 07 18:16:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:50 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6 Jul 07 18:16:50 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:50 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.info Jul 07 18:16:50 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:51 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-599f0f03-e565-4803-94be-60b05deba8a6" returned: 0 in 0.656s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-599f0f03-e565-4803-94be-60b05deba8a6" released by "delete_volume" :: held 1.525s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:51 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.info" returned: 0 in 0.689s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.352s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Created reservations ['a1f54515-e101-4e80-be37-52479a89c267', '3c150c71-39f5-49db-9a39-d3ec868c7941', '26bda532-727f-40ad-92e4-aa5acea14b1a', '6ee99da4-a3df-4fc0-8ab9-74233cae7685'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:51 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-116dc524-4075-4356-8165-04a5b9504817 tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:51 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:51 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:52 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.644s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:52 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Deleted volume successfully. Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ac90c86b-e7e2-4e39-be08-b913a843038d tempest-ProjectReaderTests-422449400 None] Lock "cinder-599f0f03-e565-4803-94be-60b05deba8a6-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-553ef64d-befe-49fc-a445-84420f070262-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Lock "cinder-553ef64d-befe-49fc-a445-84420f070262-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-553ef64d-befe-49fc-a445-84420f070262" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-553ef64d-befe-49fc-a445-84420f070262" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot 553ef64d-befe-49fc-a445-84420f070262 of volume c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb74499-1e61-4b48-874b-12be76c7a08a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (0fe0edfc-f197-4805-acd5-1db46d3a5d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4549374-a827-4bc7-b6cf-7c8099c56b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4549374-a827-4bc7-b6cf-7c8099c56b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049453253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf157c8-fd1e-48ff-8f46-f825b6de1b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:52Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea166a2-7abd-4f9f-b912-e15cb398a8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea166a2-7abd-4f9f-b912-e15cb398a8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30c90c7-9b05-4805-9577-4d721895bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30c90c7-9b05-4805-9577-4d721895bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf157c8-fd1e-48ff-8f46-f825b6de1b33', 'volume_name': 'volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7916728-0edc-490d-8ac1-4fe013e5f566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7916728-0edc-490d-8ac1-4fe013e5f566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ddf5f7-6552-4ee3-b50c-e159a3be2a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:52 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Volume 2cf157c8-fd1e-48ff-8f46-f825b6de1b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33', 'volume_size': 1} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049453253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf157c8-fd1e-48ff-8f46-f825b6de1b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567394ab78dd49a08c26284bbdc475fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:52Z,use_quota=True,user_id='5853d74db20d47b687c5c09ce780ae55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Creating volume 2cf157c8-fd1e-48ff-8f46-f825b6de1b33 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:52 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 Jul 07 18:16:52 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:52 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:52 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 1073741824 Jul 07 18:16:52 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:53 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262" returned: 0 in 0.829s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:53 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:16:53 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[642a086f-3e23-4d23-aa13-c1842e89a6e2]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:53 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 Jul 07 18:16:53 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:53 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 1073741824" returned: 0 in 0.883s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:53 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 Jul 07 18:16:53 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:54 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" returned: 0 in 0.826s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:54 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:54 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 Jul 07 18:16:54 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" returned: 0 in 0.678s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ddf5f7-6552-4ee3-b50c-e159a3be2a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c774699-3ed8-442a-bb7a-6325b96d0fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:54 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Volume volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 (2cf157c8-fd1e-48ff-8f46-f825b6de1b33): created successfully Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c774699-3ed8-442a-bb7a-6325b96d0fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Flow 'volume_create_manager' (0fe0edfc-f197-4805-acd5-1db46d3a5d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:54 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c72177a8-21f5-4582-a797-924da5b7c8c4 tempest-ProjectReaderTests-422449400 None] Created volume successfully. Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Creating offline snapshot ce6468cb-924c-4073-8945-757b9a494ae4 of volume 2cf157c8-fd1e-48ff-8f46-f825b6de1b33 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee17e58-050f-4208-8d79-73fcbb9516bf]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:54 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 Jul 07 18:16:54 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:54 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262" returned: 0 in 0.785s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:54 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262 Jul 07 18:16:54 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:55 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" returned: 0 in 0.773s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:55 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 1G Jul 07 18:16:55 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:55 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1.553ef64d-befe-49fc-a445-84420f070262" returned: 0 in 0.656s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-553ef64d-befe-49fc-a445-84420f070262" released by "_delete_snapshot" :: held 3.215s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" released by "delete_snapshot" :: held 3.242s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:55 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Created reservations ['1690d193-6832-40c2-8598-be5da8d0c7dd', '6247bf96-3f90-45f3-b3f5-ffe07c1bc415', 'ee43416d-8add-4a8b-9f87-92c86eff2cd5', 'b1c6c72c-411f-40cb-87b1-64be4500e4a1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:55 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:16:55 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-bf6d94ab-327e-4e49-b51f-bbc8665e927d tempest-ProjectMemberTests-1312511502 None] Lock "cinder-553ef64d-befe-49fc-a445-84420f070262-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:56 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 1G" returned: 0 in 0.820s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:56 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 Jul 07 18:16:56 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:56 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" acquired by "delete_volume" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:56 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee8cec3-dce9-48e1-92c5-1fccc459ced3]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:56 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 Jul 07 18:16:56 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:57 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4" returned: 0 in 0.772s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:57 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 is being set with open permissions: ugo+rw Jul 07 18:16:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:57 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 Jul 07 18:16:57 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:57 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" returned: 0 in 0.888s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:57 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1 Jul 07 18:16:57 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:57 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4" returned: 0 in 0.721s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:57 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.info Jul 07 18:16:57 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:58 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" returned: 0 in 0.660s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1" released by "delete_volume" :: held 1.619s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Created reservations ['a4958cd0-5f62-48ba-9080-fe2c659be734', '460415a8-3027-47d1-842f-b7e5b8965573', 'cf3fba19-a66c-4597-9604-7f0293eaf023', '8e154456-089e-4d89-b0eb-d7311f3da6a1'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:58 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:16:58 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:58 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.info" returned: 0 in 0.683s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:58 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.info is being set with open permissions: ugo+rw Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:58 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.info Jul 07 18:16:58 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:58 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.696s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:58 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-1762297c-fa6a-4df0-93d6-39388e3a2b33 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-c5bbb6d4-4a5e-46fb-98ab-00265d5d9cc1-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:16:59 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.info" returned: 0 in 0.675s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.527s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:59 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-01759a12-6736-4836-ad9a-2187fcc78e0a tempest-ProjectReaderTests-422449400 None] Create snapshot completed successfully Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (e9d60cbb-555f-4bdf-9dda-9322c92dfbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3e6a06-b812-40e3-b477-b6c488416498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3e6a06-b812-40e3-b477-b6c488416498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240915917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231d9d6d-8ee4-4cf6-97fb-07fae78336e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:59Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34985b0-cdfe-4a20-89a7-6f3af3b4b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34985b0-cdfe-4a20-89a7-6f3af3b4b891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff560b57-44a3-4099-9a2c-ddb673b764a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff560b57-44a3-4099-9a2c-ddb673b764a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '231d9d6d-8ee4-4cf6-97fb-07fae78336e1', 'volume_name': 'volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd3b899-f5b7-428a-b1c2-2ea467bce53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd3b899-f5b7-428a-b1c2-2ea467bce53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8244efac-78ec-4546-87e3-e88d4b5df9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:59 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Volume 231d9d6d-8ee4-4cf6-97fb-07fae78336e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1', 'volume_size': 1} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240915917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=231d9d6d-8ee4-4cf6-97fb-07fae78336e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:59Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Creating volume 231d9d6d-8ee4-4cf6-97fb-07fae78336e1 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:59 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:59 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 1073741824 Jul 07 18:16:59 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-ce6468cb-924c-4073-8945-757b9a494ae4-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Lock "cinder-ce6468cb-924c-4073-8945-757b9a494ae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-ce6468cb-924c-4073-8945-757b9a494ae4" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-ce6468cb-924c-4073-8945-757b9a494ae4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Deleting offline snapshot ce6468cb-924c-4073-8945-757b9a494ae4 of volume 2cf157c8-fd1e-48ff-8f46-f825b6de1b33 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] snapshot_file for this snap is: volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d228b7-87fd-491d-8527-33328dba8379]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:00 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 Jul 07 18:17:00 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:00 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 1073741824" returned: 0 in 0.851s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:00 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 Jul 07 18:17:00 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:00 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4" returned: 0 in 0.797s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4c3d0a-8049-4e47-b18f-b42929722c65]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:00 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" returned: 0 in 0.649s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8244efac-78ec-4546-87e3-e88d4b5df9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccba9fc8-bf32-41d9-96c5-a73e77a57589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:00 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Volume volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 (231d9d6d-8ee4-4cf6-97fb-07fae78336e1): created successfully Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccba9fc8-bf32-41d9-96c5-a73e77a57589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:00 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 Jul 07 18:17:00 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:00 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (e9d60cbb-555f-4bdf-9dda-9322c92dfbdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:00 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-2a465196-f95b-4573-8a76-9af43c1a202b tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:17:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:01 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot fa754e94-f439-498a-8aa3-490a8101c913 of volume 231d9d6d-8ee4-4cf6-97fb-07fae78336e1 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:17:01 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[e076e23b-a0b7-4666-837f-9b12ffe1d688]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:01 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 Jul 07 18:17:01 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:01 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" returned: 0 in 0.855s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:01 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:01 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 Jul 07 18:17:01 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:02 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" returned: 0 in 0.769s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:02 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 1G Jul 07 18:17:02 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:02 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4" returned: 0 in 0.797s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:02 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:02 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4 Jul 07 18:17:02 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:03 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33.ce6468cb-924c-4073-8945-757b9a494ae4" returned: 0 in 0.701s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:03 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-ce6468cb-924c-4073-8945-757b9a494ae4" released by "_delete_snapshot" :: held 3.241s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 1G" returned: 0 in 0.902s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" released by "delete_snapshot" :: held 3.272s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:03 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 Jul 07 18:17:03 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Created reservations ['26b69c50-164d-4927-855b-e77937bf1160', 'b2570fa7-5ff1-4cf8-9984-8dc0d19a15f0', 'f5f966f9-f6e6-4d36-b8ff-194b171114c1', 'a184d007-3726-4a2e-aa4b-854a48157e8a'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:03 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Delete snapshot completed successfully. Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-f8fc00dc-dc4a-4f69-9203-9e7b49db878c tempest-ProjectReaderTests-422449400 None] Lock "cinder-ce6468cb-924c-4073-8945-757b9a494ae4-delete_snapshot" released by "delete_snapshot" :: held 3.449s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:03 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913" returned: 0 in 0.726s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:03 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 is being set with open permissions: ugo+rw Jul 07 18:17:03 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:03 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 Jul 07 18:17:03 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-2cf157c8-fd1e-48ff-8f46-f825b6de1b33-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Lock "cinder-2cf157c8-fd1e-48ff-8f46-f825b6de1b33-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Acquiring lock "cinder-quobyte-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:04 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" acquired by "delete_volume" :: waited 0.024s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8727dd-549f-45a2-bb4e-a6f44f40858d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:04 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 Jul 07 18:17:04 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:04 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913" returned: 0 in 0.645s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:04 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.info Jul 07 18:17:04 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:05 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" returned: 0 in 0.773s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:05 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33 Jul 07 18:17:05 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:05 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.info" returned: 0 in 0.661s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:05 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.info is being set with open permissions: ugo+rw Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:05 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.info Jul 07 18:17:05 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:05 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" returned: 0 in 0.686s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Lock "cinder-quobyte-2cf157c8-fd1e-48ff-8f46-f825b6de1b33" released by "delete_volume" :: held 1.526s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Created reservations ['3753aa29-4368-4c89-ad76-581887dff270', 'a86d16d1-511d-409b-9102-d5cdb44a09c5', '75c22479-2e31-4683-bdda-6365e4f26c76', 'afd2276d-fbc1-45ca-89b3-4ca0b97cc721'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:05 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:17:05 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:05 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.info" returned: 0 in 0.687s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.478s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:05 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-788b34f7-f1a7-4182-87eb-11da74c7eac3 tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:17:06 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.646s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:06 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Deleted volume successfully. Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b296269d-3e5e-424c-817e-23ad48d90389 tempest-ProjectReaderTests-422449400 None] Lock "cinder-2cf157c8-fd1e-48ff-8f46-f825b6de1b33-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-fa754e94-f439-498a-8aa3-490a8101c913-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-fa754e94-f439-498a-8aa3-490a8101c913-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-fa754e94-f439-498a-8aa3-490a8101c913" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-fa754e94-f439-498a-8aa3-490a8101c913" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot fa754e94-f439-498a-8aa3-490a8101c913 of volume 231d9d6d-8ee4-4cf6-97fb-07fae78336e1 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06985ec-48dc-4ed2-b56c-57588d2890d5]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:06 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 Jul 07 18:17:06 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:07 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913" returned: 0 in 0.822s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:17:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[2697855b-3026-4117-9f38-797efa2c4f82]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:07 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 Jul 07 18:17:07 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:08 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" returned: 0 in 0.840s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:08 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 Jul 07 18:17:08 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:09 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913" returned: 0 in 0.820s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:09 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913 Jul 07 18:17:09 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:10 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1.fa754e94-f439-498a-8aa3-490a8101c913" returned: 0 in 0.685s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-fa754e94-f439-498a-8aa3-490a8101c913" released by "_delete_snapshot" :: held 3.280s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" released by "delete_snapshot" :: held 3.307s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:10 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Created reservations ['d59ec672-f49f-40e2-bb3e-3310eef581a0', 'f8972e9a-5739-43bf-98bf-4fc5f3c58aaa', '0ee19618-ac86-4872-b45b-8070123c81d5', '0226b0fb-fb4c-4b60-8c8a-0d0f6b5f310e'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:17:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-c4ee567a-4cbc-4405-9467-e8f0efabe782 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-fa754e94-f439-498a-8aa3-490a8101c913-delete_snapshot" released by "delete_snapshot" :: held 3.437s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-231d9d6d-8ee4-4cf6-97fb-07fae78336e1-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-231d9d6d-8ee4-4cf6-97fb-07fae78336e1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" acquired by "delete_volume" :: waited 0.021s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:11 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fae0aa-699d-4e3f-9370-a32fb014619d]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:11 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 Jul 07 18:17:11 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:11 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" returned: 0 in 0.785s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:11 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1 Jul 07 18:17:11 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:12 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" returned: 0 in 0.645s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-231d9d6d-8ee4-4cf6-97fb-07fae78336e1" released by "delete_volume" :: held 1.496s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Created reservations ['9a6e7de3-95fc-4229-9870-719cfc3911d9', '10865025-16dd-4f7d-a4e9-cc2926edabe1', 'e75d3b2b-e459-4c54-b58b-84dc8ff60367', 'f16a9d6d-9462-4716-865f-0fb05f52ed5c'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:12 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:17:12 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:13 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.713s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:13 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-5f23ca9e-1af5-4c26-87da-1fadd3676ff7 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-231d9d6d-8ee4-4cf6-97fb-07fae78336e1-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (d105105e-b641-401a-be74-b4e9259c5d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ec6bc-2e8b-4bd9-9ad6-e7e6648dff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ec6bc-2e8b-4bd9-9ad6-e7e6648dff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135778335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb33a28a-c386-46fa-b679-53e1d8a723c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:14Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ee81f-3e98-4ebf-a857-dcfefb50a0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ee81f-3e98-4ebf-a857-dcfefb50a0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c49c1b-e204-4be7-8407-b49a274b4a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c49c1b-e204-4be7-8407-b49a274b4a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb33a28a-c386-46fa-b679-53e1d8a723c5', 'volume_name': 'volume-bb33a28a-c386-46fa-b679-53e1d8a723c5', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e85530-bc1d-4bae-91e4-7f79fbe94aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0e85530-bc1d-4bae-91e4-7f79fbe94aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c43940d-47de-4e65-ae48-b8dc994e4c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:13 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Volume bb33a28a-c386-46fa-b679-53e1d8a723c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb33a28a-c386-46fa-b679-53e1d8a723c5', 'volume_size': 1} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135778335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb33a28a-c386-46fa-b679-53e1d8a723c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c154a3dc4c3a44c49d0f971095e43d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:14Z,use_quota=True,user_id='f3e5b369d32b45ca9dc7159534a5a53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Creating volume bb33a28a-c386-46fa-b679-53e1d8a723c5 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:17:13 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:17:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:13 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 1073741824 Jul 07 18:17:13 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:14 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 1073741824" returned: 0 in 0.826s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:14 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 Jul 07 18:17:14 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:15 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5" returned: 0 in 0.677s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c43940d-47de-4e65-ae48-b8dc994e4c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb33a28a-c386-46fa-b679-53e1d8a723c5', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045bde0c-59ff-4b78-a283-fd093b2adeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:15 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Volume volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 (bb33a28a-c386-46fa-b679-53e1d8a723c5): created successfully Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045bde0c-59ff-4b78-a283-fd093b2adeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Flow 'volume_create_manager' (d105105e-b641-401a-be74-b4e9259c5d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:15 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-da7514db-4708-48c7-9484-aef35399467d tempest-ProjectMemberTests-1312511502 None] Created volume successfully. Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=177,cinder:SELECT=120,cinder:INSERT=51,cinder:DELETE=12 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=159,cinder:DELETE=15,cinder:SELECT=131,cinder:INSERT=40 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:17:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Creating offline snapshot 20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 of volume bb33a28a-c386-46fa-b679-53e1d8a723c5 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:17:16 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ec0c8-0ff9-4aee-9d83-371e11089574]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:16 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 Jul 07 18:17:16 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:16 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5" returned: 0 in 0.840s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:16 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 1G Jul 07 18:17:16 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:17 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 1G" returned: 0 in 0.806s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:17 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:17 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 Jul 07 18:17:17 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:18 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7" returned: 0 in 0.739s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:18 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 is being set with open permissions: ugo+rw Jul 07 18:17:18 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:18 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 Jul 07 18:17:18 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:18 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:17:18 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Flow 'volume_create_manager' (160f33c4-2f21-4b7f-af12-1731cfd1ec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8735b88a-3149-4a3b-a310-6b36b8ea9e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8735b88a-3149-4a3b-a310-6b36b8ea9e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280550277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c70597-de65-4da7-8fab-91111600cf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a7d2c066b74a1dae551b17242ea31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:19Z,use_quota=True,user_id='77bf04404da8413eb4b80d34ae666612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:19 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d60572-6beb-4b3d-9c7a-d424a8c376a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d60572-6beb-4b3d-9c7a-d424a8c376a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde34ea4-c889-4989-b7fa-65d1e0a9eebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde34ea4-c889-4989-b7fa-65d1e0a9eebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c70597-de65-4da7-8fab-91111600cf5a', 'volume_name': 'volume-97c70597-de65-4da7-8fab-91111600cf5a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa067ae9-e570-4ff3-8ba7-2c086d2066dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa067ae9-e570-4ff3-8ba7-2c086d2066dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715c412c-3ea5-4f0d-85f9-a9fb93d4e58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:19 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Volume 97c70597-de65-4da7-8fab-91111600cf5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c70597-de65-4da7-8fab-91111600cf5a', 'volume_size': 1} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7" returned: 0 in 0.664s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:19 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.info Jul 07 18:17:19 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:19 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.info" returned: 0 in 0.671s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:19 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.info is being set with open permissions: ugo+rw Jul 07 18:17:19 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:19 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.info Jul 07 18:17:19 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:20 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.info" returned: 0 in 0.631s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.453s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280550277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c70597-de65-4da7-8fab-91111600cf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a7d2c066b74a1dae551b17242ea31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:19Z,use_quota=True,user_id='77bf04404da8413eb4b80d34ae666612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Creating volume 97c70597-de65-4da7-8fab-91111600cf5a {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:17:20 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:17:20 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:20 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a 1073741824 Jul 07 18:17:20 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:20 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-db3234d4-a082-4d93-b742-5f164e418398 tempest-ProjectMemberTests-1312511502 None] Create snapshot completed successfully Jul 07 18:17:21 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a 1073741824" returned: 0 in 0.815s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-20cb5294-f5e5-4a5b-bce3-8b7b33d585d7-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:21 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a Jul 07 18:17:21 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Lock "cinder-20cb5294-f5e5-4a5b-bce3-8b7b33d585d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-bb33a28a-c386-46fa-b679-53e1d8a723c5" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-bb33a28a-c386-46fa-b679-53e1d8a723c5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-20cb5294-f5e5-4a5b-bce3-8b7b33d585d7" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-20cb5294-f5e5-4a5b-bce3-8b7b33d585d7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Deleting offline snapshot 20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 of volume bb33a28a-c386-46fa-b679-53e1d8a723c5 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] snapshot_file for this snap is: volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[672906c5-6b55-4515-9afb-c4dda2355d5f]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:21 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 Jul 07 18:17:21 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:21 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a" returned: 0 in 0.628s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715c412c-3ea5-4f0d-85f9-a9fb93d4e58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c70597-de65-4da7-8fab-91111600cf5a', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3aa6c3f-9ffd-4f85-ad2c-cc6a68c6fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:21 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Volume volume-97c70597-de65-4da7-8fab-91111600cf5a (97c70597-de65-4da7-8fab-91111600cf5a): created successfully Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3aa6c3f-9ffd-4f85-ad2c-cc6a68c6fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:21 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Flow 'volume_create_manager' (160f33c4-2f21-4b7f-af12-1731cfd1ec3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:21 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-9ea1210a-12fe-44c4-8c5c-b5da3684ba54 tempest-ProjectReaderTests-42186734 None] Created volume successfully. Jul 07 18:17:22 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7" returned: 0 in 0.758s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb33a28a-c386-46fa-b679-53e1d8a723c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ba4e44-9fa8-49f8-a953-c4847f864120]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Acquiring lock "cinder-97c70597-de65-4da7-8fab-91111600cf5a-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Lock "cinder-97c70597-de65-4da7-8fab-91111600cf5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:22 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 Jul 07 18:17:22 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Acquiring lock "cinder-quobyte-97c70597-de65-4da7-8fab-91111600cf5a" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Lock "cinder-quobyte-97c70597-de65-4da7-8fab-91111600cf5a" acquired by "delete_volume" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e1f920-acea-42e6-b9df-c12ea1c42034]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:22 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a Jul 07 18:17:22 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:22 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5" returned: 0 in 0.762s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:22 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:22 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 Jul 07 18:17:22 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:23 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a" returned: 0 in 0.753s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:23 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a Jul 07 18:17:23 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:23 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7" returned: 0 in 0.744s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:23 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7 Jul 07 18:17:23 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:23 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-97c70597-de65-4da7-8fab-91111600cf5a" returned: 0 in 0.725s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:23 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:17:23 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Lock "cinder-quobyte-97c70597-de65-4da7-8fab-91111600cf5a" released by "delete_volume" :: held 1.529s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Created reservations ['a2503aae-ad87-44bf-8854-2b5b4f8f2fad', 'dfbd9e78-0b94-43be-9542-d6bd7d7d81b1', '16b8dac8-52aa-44c4-854e-22d278142271', 'c6f5667b-60da-4c72-892d-c16de4d6d663'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:23 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:17:23 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:24 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5.20cb5294-f5e5-4a5b-bce3-8b7b33d585d7" returned: 0 in 0.692s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-20cb5294-f5e5-4a5b-bce3-8b7b33d585d7" released by "_delete_snapshot" :: held 3.095s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-bb33a28a-c386-46fa-b679-53e1d8a723c5" released by "delete_snapshot" :: held 3.127s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:24 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.707s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Created reservations ['8d9f99d1-78ec-4938-95f6-efd762f6dee8', '6908769b-3445-42c4-a2d1-bded8c41d373', '190021ae-4698-4d56-831c-7df51d426c4d', 'a7f5b7b0-e526-405f-b1c4-f0acbcf6fe43'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Delete snapshot completed successfully. Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ba78f7db-3843-4f0d-b799-a8b456f7d27b tempest-ProjectMemberTests-1312511502 None] Lock "cinder-20cb5294-f5e5-4a5b-bce3-8b7b33d585d7-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:24 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.692s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:24 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Deleted volume successfully. Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-6523cdd8-fb93-489a-8ad0-8a3dbcb0b821 tempest-ProjectReaderTests-42186734 None] Lock "cinder-97c70597-de65-4da7-8fab-91111600cf5a-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Flow 'volume_create_manager' (c3222a74-d2dc-421d-b40b-5ac560083416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee052db5-d578-4fc0-a259-3e33d75cad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee052db5-d578-4fc0-a259-3e33d75cad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097410791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071208c2-726f-4636-b180-a441ca44dd42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a7d2c066b74a1dae551b17242ea31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:25Z,use_quota=True,user_id='77bf04404da8413eb4b80d34ae666612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56588f5-0472-4db4-a256-9f4de369cbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56588f5-0472-4db4-a256-9f4de369cbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654d0b91-093c-43c6-a1f0-2fbc85d5694e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654d0b91-093c-43c6-a1f0-2fbc85d5694e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071208c2-726f-4636-b180-a441ca44dd42', 'volume_name': 'volume-071208c2-726f-4636-b180-a441ca44dd42', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5bad1e-c7ef-49c9-ad8e-dfad92b1b9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5bad1e-c7ef-49c9-ad8e-dfad92b1b9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f66f614-f417-4239-8ed2-c7723a01800d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:25 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Volume 071208c2-726f-4636-b180-a441ca44dd42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071208c2-726f-4636-b180-a441ca44dd42', 'volume_size': 1} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2097410791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071208c2-726f-4636-b180-a441ca44dd42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a7d2c066b74a1dae551b17242ea31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:25Z,use_quota=True,user_id='77bf04404da8413eb4b80d34ae666612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Creating volume 071208c2-726f-4636-b180-a441ca44dd42 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:17:25 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:25 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 1073741824 Jul 07 18:17:25 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-bb33a28a-c386-46fa-b679-53e1d8a723c5-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-bb33a28a-c386-46fa-b679-53e1d8a723c5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "cinder-quobyte-bb33a28a-c386-46fa-b679-53e1d8a723c5" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-bb33a28a-c386-46fa-b679-53e1d8a723c5" acquired by "delete_volume" :: waited 0.014s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbaae99-2a48-4955-afb3-4459950a9a8c]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:25 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 Jul 07 18:17:25 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:25 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 1073741824" returned: 0 in 0.861s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:25 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:25 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 Jul 07 18:17:25 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:26 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5" returned: 0 in 0.777s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:26 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5 Jul 07 18:17:26 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:26 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42" returned: 0 in 0.642s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f66f614-f417-4239-8ed2-c7723a01800d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071208c2-726f-4636-b180-a441ca44dd42', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0b2172-204c-4206-ba16-7baaf4660bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:26 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Volume volume-071208c2-726f-4636-b180-a441ca44dd42 (071208c2-726f-4636-b180-a441ca44dd42): created successfully Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0b2172-204c-4206-ba16-7baaf4660bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:26 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Flow 'volume_create_manager' (c3222a74-d2dc-421d-b40b-5ac560083416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:26 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-5a97e234-c467-4af4-923c-f3a9080bdff1 tempest-ProjectReaderTests-42186734 None] Created volume successfully. Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Acquiring lock "cinder-071208c2-726f-4636-b180-a441ca44dd42-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Lock "cinder-071208c2-726f-4636-b180-a441ca44dd42-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Acquiring lock "cinder-quobyte-071208c2-726f-4636-b180-a441ca44dd42" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Lock "cinder-quobyte-071208c2-726f-4636-b180-a441ca44dd42" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[f214b5cc-0708-498f-a0e6-de5368f59372]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:27 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-bb33a28a-c386-46fa-b679-53e1d8a723c5" returned: 0 in 0.694s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-quobyte-bb33a28a-c386-46fa-b679-53e1d8a723c5" released by "delete_volume" :: held 1.533s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Created reservations ['02e3bf93-b654-43ef-b2cd-25e9ae6ffc46', '94b86082-8320-4b23-8f03-8ec8819dcda7', 'eb5d72f3-dad2-431c-95b6-ff243777531d', '17ef2e9d-35b3-4e76-bfd1-b51657ca07a8'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:27 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 Jul 07 18:17:27 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:27 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:17:27 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:27 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42" returned: 0 in 0.819s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:27 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:27 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.675s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:28 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42 Jul 07 18:17:28 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:28 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Deleted volume successfully. Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-89fc1828-3bd6-484e-ac67-02fb01d62d81 tempest-ProjectMemberTests-1312511502 None] Lock "cinder-bb33a28a-c386-46fa-b679-53e1d8a723c5-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:28 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-071208c2-726f-4636-b180-a441ca44dd42" returned: 0 in 0.698s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Lock "cinder-quobyte-071208c2-726f-4636-b180-a441ca44dd42" released by "delete_volume" :: held 1.559s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Created reservations ['5f75926f-56f9-44a6-afa7-23feb8bf7925', 'd903ec28-4c2e-480e-8f27-14e672588792', '1ba454aa-df07-41df-96ae-a294219e9ba4', 'ba54fc53-48a4-4cc3-936d-4e25df9d2710'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:28 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:28 devstack sudo[108694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:17:28 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:29 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:29 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.686s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:29 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:29 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Deleted volume successfully. Jul 07 18:17:29 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-19823626-5e32-4355-8b7a-6e0849480a49 tempest-ProjectReaderTests-42186734 None] Lock "cinder-071208c2-726f-4636-b180-a441ca44dd42-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:38 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:UPDATE=34,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:17:39 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=27,cinder:UPDATE=40,cinder:DELETE=5,cinder:INSERT=11 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Flow 'volume_create_manager' (b823a9fd-cf8e-477a-abaa-666411a7a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6c5649-aa74-4528-b9f6-2191bd5e4b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6c5649-aa74-4528-b9f6-2191bd5e4b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-829493587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204c2511-28a7-4481-940e-6a4238e8e5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a3a6bb1d03496f85084c4c3ca8de34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:51Z,use_quota=True,user_id='5efe03745ef04acd91875a3d886aab7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c29073-58d3-4025-9107-9064bc1dfa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c29073-58d3-4025-9107-9064bc1dfa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8c713d-e4ba-4f99-82c1-875022fb293b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8c713d-e4ba-4f99-82c1-875022fb293b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '204c2511-28a7-4481-940e-6a4238e8e5c2', 'volume_name': 'volume-204c2511-28a7-4481-940e-6a4238e8e5c2', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4fb16c-b9bf-4710-bd06-4dd2429d1194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4fb16c-b9bf-4710-bd06-4dd2429d1194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2020120f-2ed1-429f-a81f-7a171064ad2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:50 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Volume 204c2511-28a7-4481-940e-6a4238e8e5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-204c2511-28a7-4481-940e-6a4238e8e5c2', 'volume_size': 1} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-829493587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204c2511-28a7-4481-940e-6a4238e8e5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a3a6bb1d03496f85084c4c3ca8de34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:51Z,use_quota=True,user_id='5efe03745ef04acd91875a3d886aab7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)}" {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Creating volume 204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:17:50 devstack cinder-volume[87228]: INFO cinder.volume.drivers.remotefs [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] casted to osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 Jul 07 18:17:50 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 1073741824 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:50 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 1073741824 Jul 07 18:17:50 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:51 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 1073741824" returned: 0 in 0.772s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:51 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:51 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 Jul 07 18:17:51 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:52 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2" returned: 0 in 0.653s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'} {{(pid=87228) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2020120f-2ed1-429f-a81f-7a171064ad2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204c2511-28a7-4481-940e-6a4238e8e5c2', 'volume_size': 1}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcabd26-d89e-48b0-bfac-01d07f0d35b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:52 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Volume volume-204c2511-28a7-4481-940e-6a4238e8e5c2 (204c2511-28a7-4481-940e-6a4238e8e5c2): created successfully Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcabd26-d89e-48b0-bfac-01d07f0d35b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Flow 'volume_create_manager' (b823a9fd-cf8e-477a-abaa-666411a7a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:52 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-06ab9907-6d96-44d7-b467-3f3f98c73dcb tempest-SnapshotDependencyTests-1078968178 None] Created volume successfully. Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Creating offline snapshot aebe6b39-4978-4125-81e6-26568b96ed43 of volume 204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[709c8c05-318c-41bb-b75e-5b98f24c1548]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:52 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:53 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 Jul 07 18:17:53 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:53 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2" returned: 0 in 0.764s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:53 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 1G {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:53 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 1G Jul 07 18:17:53 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:54 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 1G" returned: 0 in 0.802s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:54 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204c2511-28a7-4481-940e-6a4238e8e5c2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:54 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204c2511-28a7-4481-940e-6a4238e8e5c2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 Jul 07 18:17:54 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:55 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-204c2511-28a7-4481-940e-6a4238e8e5c2 -F qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43" returned: 0 in 0.736s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:55 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 is being set with open permissions: ugo+rw Jul 07 18:17:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:55 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 Jul 07 18:17:55 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:55 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43" returned: 0 in 0.640s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:55 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:55 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.info Jul 07 18:17:55 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:56 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.info" returned: 0 in 0.658s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:56 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.info is being set with open permissions: ugo+rw Jul 07 18:17:56 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.info {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:56 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.info Jul 07 18:17:56 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:57 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.info" returned: 0 in 0.666s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:57 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.346s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:57 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-0024101f-80aa-45e3-beb2-ac2c7fbe4f98 tempest-SnapshotDependencyTests-1078968178 None] Create snapshot completed successfully Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87228) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Flow 'volume_create_manager' (0f57c924-a3ba-4dc8-b919-b375308f4a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa12dcf-1644-4526-9598-80aacfd16ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa12dcf-1644-4526-9598-80aacfd16ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff394fd6-57ee-4c1e-ad21-446a1e4910b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a3a6bb1d03496f85084c4c3ca8de34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aebe6b39-4978-4125-81e6-26568b96ed43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:59Z,use_quota=True,user_id='5efe03745ef04acd91875a3d886aab7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc39dfe6-ae6a-4d76-b74a-477f582199e0),volume_type_id=bc39dfe6-ae6a-4d76-b74a-477f582199e0)' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436306a6-8b89-455c-bd7c-634e78f78e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436306a6-8b89-455c-bd7c-634e78f78e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caaffa7b-6be0-451b-a2fc-34924e6e5362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caaffa7b-6be0-451b-a2fc-34924e6e5362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ff394fd6-57ee-4c1e-ad21-446a1e4910b1', 'volume_name': 'volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1', 'volume_size': 1, 'snapshot_id': 'aebe6b39-4978-4125-81e6-26568b96ed43'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9b569f-923d-4413-a054-36e9aa89136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9b569f-923d-4413-a054-36e9aa89136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d0e6dd-d553-4b1e-bec5-2fe25a419b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:58 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Volume ff394fd6-57ee-4c1e-ad21-446a1e4910b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1', 'volume_size': 1, 'snapshot_id': 'aebe6b39-4978-4125-81e6-26568b96ed43'} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-quobyte-aebe6b39-4978-4125-81e6-26568b96ed43-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" by "_create_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-aebe6b39-4978-4125-81e6-26568b96ed43-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Creating volume ff394fd6-57ee-4c1e-ad21-446a1e4910b1 from snapshot aebe6b39-4978-4125-81e6-26568b96ed43 {{(pid=87228) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Selected osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964 as target Quobyte volume. {{(pid=87228) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-quobyte-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" by "_copy_volume_from_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] snapshot: aebe6b39-4978-4125-81e6-26568b96ed43, volume: ff394fd6-57ee-4c1e-ad21-446a1e4910b1, {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa79b36-508d-4a53-967c-b9cdcf43baa4]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:58 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:59 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 Jul 07 18:17:59 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:59 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43" returned: 0 in 0.748s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-204c2511-28a7-4481-940e-6a4238e8e5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:17:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:17:59 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Creating direct copy from snapshot {{(pid=87228) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:17:59 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d16c02-7d9c-45cd-84c4-595c6034ab21]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:59 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:59 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 Jul 07 18:17:59 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:00 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2" returned: 0 in 0.771s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:00 devstack cinder-volume[87228]: DEBUG cinder.utils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Path /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 not found in is_blk_device check {{(pid=87228) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:18:00 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:00 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 Jul 07 18:18:00 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:04 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" returned: 0 in 4.382s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:04 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[77be96ab-582c-4e5d-88ef-d92b93444665]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:04 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:04 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 Jul 07 18:18:04 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:05 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2" returned: 0 in 0.962s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:05 devstack cinder-volume[87228]: DEBUG cinder.image.image_utils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Image conversion details: src /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 {{(pid=87228) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:18:05 devstack cinder-volume[87228]: INFO cinder.image.image_utils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Converted 1024.00 MB image at 233.60 MB/s Jul 07 18:18:05 devstack cinder-volume[87228]: WARNING cinder.volume.drivers.remotefs [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 is being set with open permissions: ugo+rw Jul 07 18:18:05 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:05 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 Jul 07 18:18:05 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:06 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" returned: 0 in 0.628s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" released by "_copy_volume_from_snapshot" :: held 7.584s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:06 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-aebe6b39-4978-4125-81e6-26568b96ed43-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" released by "_create_volume_from_snapshot" :: held 7.616s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:06 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.630s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d0e6dd-d553-4b1e-bec5-2fe25a419b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1', 'volume_size': 1, 'snapshot_id': 'aebe6b39-4978-4125-81e6-26568b96ed43'}' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba9a9fb-baf4-44ca-8057-749ad186e707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:06 devstack cinder-volume[87228]: INFO cinder.volume.flows.manager.create_volume [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Volume volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 (ff394fd6-57ee-4c1e-ad21-446a1e4910b1): created successfully Jul 07 18:18:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba9a9fb-baf4-44ca-8057-749ad186e707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87228) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:06 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Flow 'volume_create_manager' (0f57c924-a3ba-4dc8-b919-b375308f4a9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87228) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:06 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-00a8f168-06d9-4125-b38d-50495ab9cb7e tempest-SnapshotDependencyTests-1078968178 None] Created volume successfully. Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-aebe6b39-4978-4125-81e6-26568b96ed43-delete_snapshot" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-aebe6b39-4978-4125-81e6-26568b96ed43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-quobyte-204c2511-28a7-4481-940e-6a4238e8e5c2" by "delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-204c2511-28a7-4481-940e-6a4238e8e5c2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-quobyte-aebe6b39-4978-4125-81e6-26568b96ed43" by "_delete_snapshot" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-aebe6b39-4978-4125-81e6-26568b96ed43" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Deleting offline snapshot aebe6b39-4978-4125-81e6-26568b96ed43 of volume 204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] snapshot_file for this snap is: volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 {{(pid=87228) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4dae5-cdee-4c65-b629-9d0e92426901]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:07 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:07 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 Jul 07 18:18:07 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:08 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43" returned: 0 in 0.779s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:08 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.remotefs [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-204c2511-28a7-4481-940e-6a4238e8e5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87228) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:18:08 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[b913bc19-c930-480a-8a98-c42de7ec60a1]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:08 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:08 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 Jul 07 18:18:08 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:09 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2" returned: 0 in 0.744s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:09 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 Jul 07 18:18:09 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:09 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43" returned: 0 in 0.740s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:09 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:09 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43 Jul 07 18:18:09 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:10 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:10 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2.aebe6b39-4978-4125-81e6-26568b96ed43" returned: 0 in 0.645s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-aebe6b39-4978-4125-81e6-26568b96ed43" released by "_delete_snapshot" :: held 3.011s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-204c2511-28a7-4481-940e-6a4238e8e5c2" released by "delete_snapshot" :: held 3.036s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:10 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Created reservations ['7852a763-e8bf-44e3-abe2-7e219b1f634d', 'dc158f5b-97e5-4273-821e-475f20401c61', 'bddf8c48-d4f1-4f3d-be2e-61160aa2dd4e', '2341fd10-d4c6-4844-82ff-a47ceb037e47'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:10 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Delete snapshot completed successfully. Jul 07 18:18:10 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-a79ae2ae-b009-4225-b904-8ab44a5a73c6 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-aebe6b39-4978-4125-81e6-26568b96ed43-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-204c2511-28a7-4481-940e-6a4238e8e5c2-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-204c2511-28a7-4481-940e-6a4238e8e5c2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-quobyte-204c2511-28a7-4481-940e-6a4238e8e5c2" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:11 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-204c2511-28a7-4481-940e-6a4238e8e5c2" acquired by "delete_volume" :: waited 0.017s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:11 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[1721937a-3773-4f76-a054-d595cf792eab]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:11 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:12 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 Jul 07 18:18:12 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:12 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2" returned: 0 in 0.811s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:12 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:12 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2 Jul 07 18:18:12 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:13 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-204c2511-28a7-4481-940e-6a4238e8e5c2" returned: 0 in 0.710s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-204c2511-28a7-4481-940e-6a4238e8e5c2" released by "delete_volume" :: held 1.592s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Created reservations ['c4f514b9-0ab2-4bc7-883b-c344f0668f78', '856ee6ad-93c8-4d6b-8daa-25ac9965f788', 'e16cdf56-59f0-4aa2-b393-c2ebcba7ec80', '668472a3-eb71-4f0b-a8f1-337437cf5189'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:13 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:13 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:18:13 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-ff394fd6-57ee-4c1e-ad21-446a1e4910b1-delete_volume" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-ff394fd6-57ee-4c1e-ad21-446a1e4910b1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "cinder-quobyte-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" by "delete_volume" {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" acquired by "delete_volume" :: waited 0.019s {{(pid=87228) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08aac30-67bf-4458-975b-4d5ba13d0f4a]: (4, 'qcow2') {{(pid=88283) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:14 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.654s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:14 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Deleted volume successfully. Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-b15f1953-61cf-4982-8dca-bd037bccdcfa tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-204c2511-28a7-4481-940e-6a4238e8e5c2-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:14 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 Jul 07 18:18:14 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:14 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" returned: 0 in 0.753s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:14 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:14 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1 Jul 07 18:18:14 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:15 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b/volume-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" returned: 0 in 0.655s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-quobyte-ff394fd6-57ee-4c1e-ad21-446a1e4910b1" released by "delete_volume" :: held 1.447s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG cinder.quota [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Created reservations ['cbcd019f-b7ad-4850-bcec-ca272bd55216', 'f8340de8-4bd9-4ceb-b7a1-0cd15b0edf4f', '8b39b485-1905-465e-8c22-1f8f1c78b70b', '7ccd58ab-4be6-4cec-8479-773c86d88c5f'] {{(pid=87228) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:15 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:15 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:18:15 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:16 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:16 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.665s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:16 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:16 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Deleted volume successfully. Jul 07 18:18:16 devstack cinder-volume[87228]: DEBUG cinder.coordination [None req-ecf9b568-39f0-4fcf-81f3-76a364164a13 tempest-SnapshotDependencyTests-1078968178 None] Lock "cinder-ff394fd6-57ee-4c1e-ad21-446a1e4910b1-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87228) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:23 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:18:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964': None} {{(pid=87228) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:23 devstack cinder-volume[87228]: DEBUG cinder.volume.drivers.quobyte [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-a75d110a-ad86-48e8-9d3b-e849788cf964'] {{(pid=87228) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87228) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:23 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:23 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b Jul 07 18:18:23 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:24 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:24 devstack cinder-volume[87228]: DEBUG oslo_concurrency.processutils [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d8acfca2174f7ea0b46229d121b8da4b" returned: 0 in 0.671s {{(pid=87228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:24 devstack cinder-volume[87228]: DEBUG cinder.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Notifying Schedulers of capabilities ... {{(pid=87228) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:24 devstack cinder-volume[87228]: DEBUG oslo_service.periodic_task [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] Running periodic task VolumeManager._thread_info {{(pid=87228) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:18:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread count: 28 {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:18:24 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-85e49755-3678-4f5a-b9cb-a6fce0636ad1 None None] thread info: [<_MainThread(MainThread, started 125792099840128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87228) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 07 18:18:25 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=21,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:18:26 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=9 {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}